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CHAPTER  I 


INTRODUCTION 


Reliability  is  a  fundamental  characteristic  of  a 
system  and  is  expressed  as  the  probability  that  the  system 
will  perform  its  intended  function  for  a  specified  period 
of  time  under  stated  conditions  (4:63).  This  definition. 


however,  does  not  explain  the  many  facets  of  the  total  sys 
tern  that  influence  system  reliability.  The  term  reliabil¬ 
ity  used  in  this  thesis  cannot  simply  be  defined  as  an 
isolated  concept  of  equipment  failure.  This  concept  must 
be  broadened  to  consider  the  effects  that  other  system 
parameters  have  on  reliability.  For  example,  how  do  train 
ing,  maintenance  concepts,  design,  and  technology  affect 
reliability?  How  do  combinations  of  these  system  param¬ 
eters  affect  reliability?  Most  importantly,  where  can 
management  place  emphasis  in  order  to  achieve  an  increase 
in  the  reliability  of  the  total  system?  The  purpose  of 
this  research  is  to  provide  a  much  broader  concept  of  reli 
ability  normally  given  in  technical  reports.  The  concept 
will  be  expanded  by  constructing  a  model  which  simulates 


A  system  is  a  collection  of  parts  organized  for  a 
purpose.  In  this  thesis,  a  system  will  refer  to  a  complete 
system,  unless  otherwise  noted  in  the  text.  The  concept  of 
the  system  will  be  operationally  defined  in  subsequent 
chapters. 


the  effects  that  the  dynamic  behavior  of  a  system  has  on 
the  flying  capability  of  the  Air  Force. 

Problem  Analysis 

In  the  fiscal  year  1975  Annual  Defense  Department 
Report,  Secretary  of  Defense  Schlesinger  noted  that  the 
improvement  of  reliability  of  new  weapon  systems  was 
receiving  increased  management  attention  within  DOD  (18: 

229) .  For  example,  suitable  tools  and  techniques  for 
determining  reliability  are  required  by  managers  to  success¬ 
fully  deploy  new  weapon  systems  that  meet  mission  require¬ 
ments.  Mission  requirements  for  each  system  are  initially 
defined  in  broad  terms  by  the  Mission  Element  Need  State¬ 
ment  (MENS).  When  making  trade-off  decisions  early  in  the 
acquisition  phase,  the  manager  must  be  able  to  compare  the 
overall  reliability  of  a  weapon  system  with  the  cost  to 
operate  and  support  that  system  (7:2).  However,  existing 
models  used  to  compare  operating  and  support  (OfcS)  costs 
and  reliability  do  not  provide  realistic  cost  estimates 
(5:2)  . 

A  March  30,  1976,  letter  from  the  Senate  Appropria¬ 
tions  Committee,  requested  the  General  Accounting  Office 
(GAO)  to  determine  if  there  was  any  method  to  measure 
improved  performance  of  a  weapon  system  as  it  affects  sup¬ 
port  costs  and  manpower  requirements  (19:iv).  The  GAO 
recommended  that  the  Air  Force  and  Navy  explore  the 
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possibility  of  developing  reasonable  criteria  and  data  sys¬ 
tems  for  measuring  and  evaluating  the  results  of  the  pro¬ 
grams  for  improving  maintainability,  reliability,  and  life 
cycle  costs  (19-.A-2).  The  GAO  identified  a  need  for  a 
model  that  can  determine  the  cause-effect  relationship 
between  management  decisions  and  the  reliability  of  a 
weapon  system.  Current  management  practice  is  to  determine 
reliability  through  engineering  models  such  as  the  Duane 
Reliability  Growth  Model  (11:38). 

J.  T.  Duane  of  the  General  Electric  Motor  and 
Generator  Department  found  that  an  ongoing  test,  analysis, 
and  correction  program  would  provide  a  continually  increas¬ 
ing  Mean  Time  Between  Failure  (MTBF) . 2  The  Duane  Model 
is  an  empirically  derived  relationship  of  cumulative  fail¬ 
ure  rates  versus  cumulative  test  hours.  When  this  rela¬ 
tionship  is  plotted  on  a  log- log  scale,  the  data  points 
fall  along  a  straight  line.  Duane  and  others  have  con¬ 
firmed  this  relationship  for  many  diverse  types  of  equip¬ 
ment  (11:38-40) . 

The  Duane  Model,  the  most  widely  used  reliability 
growth  model  (11:38),  pointed  out  the  existing  limited 
notion  of  reliability.  The  Duane  Model  did  not  consider 
the  complex  interactions  among  the  many  factors  that  deter¬ 
mine  the  reliability  of  a  system. 

2MTBF  is  one  commonly  used  measurement  of  the  reli¬ 
ability  of  a  piece  of  equipment. 


It  has  become  a  common  occurrence  within  DOD  to 
expect  field  reliability  of  new  weapon  systems  to  be  less 
than  the  reliability  predicted  by  contractors  and/or  reli¬ 
ability  test  results  (12:68).  Available  data  indicated 
that  field  MTBF  is  often  only  one-tenth  of  the  specified 
MTBF  (10:30).  The  contractor's  predicted  reliability  of  a 
system  using  existing  models  apparently  cannot  relate  to 
the  actual  field  reliability  observed.  The  system  relia¬ 
bility  did  not  meet  the  predictions  because  reliability  has 
not  been  understood  or  managed  as  a  system.  All  of  the  fac¬ 
tors  that  determine  the  system  reliability  were  not  con¬ 
sidered  in  the  design  of  the  model. 

Robert  A.  Singer,  in  a  Defense  System  Management 
Report,  stressed  the  point  that  the  most  serious  disadvan¬ 
tage  of  existing  models  was  the  current  unavailability  of 
accurate  measurements  depicting  the  relationships  between 
performance  goals  with  actual  performance  achieved  (17:19). 
Also,  some  critical  assumptions  used  in  current  models  must 
be  replaced  by  more  realistic  representations  of  the 
dynamic  nature  of  systems.  When  considering  reliability 
the  models  assumed  random  failure  only.  No  provisions  were 
made  for  the  implications  of  corrosion,  fatigue,  and  wear- 
out.  Design  values  were  used  rather  than  actual  field 
failure  rates.  Secondary  failures  due  to  extrinsic  causes 
were  ignored,  even  though  the  failures  required  maintenance 
actions  (17:22-23).  The  problems  of  incorrect  part 
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replacements,  false  fault  alerts,  and  intermittent  failures 
were  not  considered  (17:73).  The  effects  on  reliability  of 
transportation,  spares  policy,  training,  quality  of  tech¬ 
nical  data,  and  support  equipment  were  also  not  included  in 
the  available  models. 

Host  models  assumed  that  an  improvement  in  relia¬ 
bility  translates  directly  into  changes  in  other  system 
parameters  (for  example,  fewer  spares,  fewer  maintenance 
actions) .  It  can  be  shown  that  an  improvement  in  reliabil¬ 
ity  may  actually  dictate  fewer  maintenance  actions.  Fewer 
maintenance  actions  might  mean  fewer  maintenance  personnel. 
However,  unless  manpower  assignments  are  reduced  to  match 
the  predicted  requirement,  none  or  only  a  small  fraction  of 
this  predicted  savings  in  manpower  will  come  about.  In 
some  situations  manpower  reductions  may  not  even  be  pos¬ 
sible  because  of  policy  considerations.  An  example  is  a 
Navy  ship  where  peak  manpower  requirements  for  critical 
functions,  such  as  deunage  control,  assumed  there  were  fixed 
levels  of  manpower  available  from  other  functions.  Also, 
fewer  maintenance  actions  may  lower  the  proficiency  of  the 
maintenance  personnel  which  could,  in  turn,  cause  a  decrease 
in  the  reliability  of  the  system  (17:23). 

The  dynamic  behavior  of  the  relationships  described 
in  the  preceding  paragraphs  must  be  understood,  measured, 
and  then  incorporated  into  a  model  for  accurate  understand¬ 
ing  of  reliability.  Using  this  model,  managers  can 
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determine  where  to  apply  available  resources  to  achieve 
desired  results. 


Problem  Statement 

The  variables  which  affect  the  reliability  of  an 
aircraft  weapon  system  are  not  adequately  understood  by 
DOD  managers. 

Concomitant  with  the  major  problem  is  a  secondary 
problem.  Management  has  not  developed  adequate  tools  to 
measure  or  define  the  interrelationships  between  reliabil¬ 
ity  and  the  elements  of  the  system  which  determine  relia¬ 
bility. 

Background 

Literature  Review 

The  available  literature  on  reliability  was  divided 
into  two  main  groups.  Figure  1-1  suranarizes  this  literature. 

One  group  dealt  strictly  with  engineering  studies 
done  to  aid  in  designing  and  predicting  reliability  of  new 
systems.  This  thesis  is  about  the  management  of  reliabil¬ 
ity  and  does  not  consider  specific  engineering  reliability 
design  techniques.  Consequently,  reliability  engineering 
studies  were  not  included  in  this  background  section. 

However,  the  concept  that  improved  design  may  increase  the 
reliability  of  a  weapon  system  is  recognized  and  will  be 
included  in  the  model.  The  remaining  literature  considered 
reliability  from  a  management  viewpoint. 
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RELIABILITY  LITERATURE 


MANAGEMENT  RELIABILITY 

Relationships  among 
reliability,  maintain¬ 
ability,  O&S  costs, 
acquisition  costs 

Life  cycle  costs  as  a 
function  of  reliability 

Design  changes  to 
increase  reliability 

Trade-off  studies  to 
determine  optimum  reli¬ 
ability 

Fig.  1-1.  Summary  of  Reliability  Literature 

The  prevalent  theme  in  the  literature  concerning 
management  of  reliability  was  expressed  by  Eldridge  P. 

Eaton.  In  his  article,  "Let's  Get  Serious  about  Life  Cycle 
Costs,"  he  stated  that  reliability  was  a  design  control¬ 
lable  characteristic  of  a  system  (7:2)  and  that  "good" 
managers  must  consider  the  relationships  among  reliability, 
maintainability,  OfcS  costs,  acquisition  costs,  spares, 
personnel,  and  all  other  logistics  factors  and  mission 
requirements  (7:3).  These  relationships  were  usually  pre¬ 
sented  in  terms  of  total  life  cycle  costs  of  a  system. 

The  management  of  any  system  is  a  continuous 
iterative  process.  Through  system  development,  design 
changes  in  various  subsystems  are  proposed  while  the  accu¬ 
racy  of  cost  estimates  as  well  as  performance  and 


ENGINEERING  RELIABILITY 

Mathematical  functions 
to  predict  reliability 

Reliability  test  results 
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effectiveness  estimates  are  being  improved.  To  manage  a 
program  by  meeting  the  performance  and  economic  goals,  a 
manager  must  have  a  timely  feedback  of  current  information 
on  the  cost  and  performance  estimates  of  all  proposed  sub¬ 
system  changes  (1:65). 

Absent  in  the  literature  was  a  rigorous  methodology 
for  conducting  the  analysis  of  the  complex  system  inter¬ 
actions.  Eaton  provided  a  description  of  what  "good"  DOD 
managers  are  expected  to  do: 

There  is  an  infinite  number  of  possible  trade-offs 
based  on  selected  logistics  alternatives.  Each  system, 
because  of  its  difference  from  other  systems,  contains 
its  own  unique  solutions.  However,  the  trade-off  pro¬ 
cesses  should  be  identical:  creating  a  balanced  design, 
which  incorporates  the  objective  evaluations  between 
intrinsic  and  extrinsic  system  characteristics,  to  pro¬ 
duce  a  system  that  has  acceptable  operational  capabil¬ 
ity  and  the  readiness  required  at  an  affordable  and 
optimal  LCC  (7:11]. 

This  limited  process  expressed  by  Eaton  does  not 
provide  substantial  help  to  a  manager  trying  to  choose  from 
an  infinite  number  of  trade-offs.  Eaton's  statement,  how¬ 
ever,  does  indicate  that  managers  are  beginning  to  under¬ 
stand  the  complex  interrelationships  they  must  deal  with. 

J.  W.  Forrester  identified  another  difficulty  mana¬ 
gers  have  when  trying  to  understand  complex  interactions. 
Forrester  believed  that  the  intuitive  judgment  of  skilled 
investigators  is  unreliable  in  anticipating  the  dynamic 
behavior  of  a  simple  system  of  five  or  six  variables.  This 


of  the  most  effective  means  available  for  supplementing  and 
correcting  human  intuition  [15:6)." 

This  computer  simulation  model  is  not  a  perfect 
representation  of  the  actual  system  making  better  decisions 
than  people  can.  It  is  a  tool  which  managers  and  policy 
makers  can  use  to  experiment  with  proposed  changes  prior 
to  actual  implementation.  Unlike  mental  models  that  most 
people  use  to  guide  their  actions  towards  a  goal,  the  com¬ 
puter  model  is  comprehensive,  unambiguous,  flexible,  and 
subject  to  rigorous  manipulation  and  testing  (15:5-6).  The 
detailed  methodology  on  how  systems  dynamics  will  be  used 
to  develop  the  computer  simulation  model  in  this  thesis  is 
contained  in  the  next  chapter. 

Described  in  the  remainder  of  this  chapter  are  some 
examples  of  existing  models  and  the  limitations  of  these 
models.  The  ability  of  systems  dynamic  models  to  overcome 
these  limitations  will  be  briefly  discussed.  The  research 
objectives  and  research  questions  derived  from  the  problem 
statement  will  then  be  presented.  The  chapter  will  con¬ 
clude  with  the  basic  premise  of  the  system  dynamics  tech¬ 
nique. 

Review  of  Existing  Models 

Computerized  mathematical  models  are  available  to 
assist  DOD  managers  in  dealing  with  large  numbers  of  vari¬ 
ables  when  making  decisions  about  reliability.  The  most 
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common  examples  are  LCC  models  that  use  the  reliability  of 
a  system  as  one  of  many  inputs.  The  U.S.  Army  Air  Mobility 
Research  and  Development  Laboratory  has  developed  the  Air¬ 
craft  Reliability  and  Maintainability  Simulation  Model 
(ARMS) . 

The  ARMS  was  developed  as  a  management  tool  which 
permits  observation  of  the  impact  of  a  proposed  maintenance 
concept  prior  to  implementation.  The  model  is  used  to 
simulate  aircraft  operating  in  user  defined  operational 
scenarios.  It  is  designed  to  allow  the  user  flexibility  in 
defining  aircraft  components  with  their  associated  failure 
rates  and  repair  requirements,  and  in  defining  necessary 
resources  such  as  ground  equipment.  The  ARMS  model  can  be 
applied  throughout  the  life  cycle  of  an  aircraft  system 
from  the  conceptual  phase  through  the  developmental,  and 
during  the  operational  phase.  It  can  be  used  to  determine 
the  system  level  impact  of  changes  in  reliability  and  main¬ 
tainability  parameters  at  the  component  level,  to  determine 
the  effectiveness  of  alternative  maintenance  concepts,  and 
to  determine  the  optimum  mix  of  maintenance  resources  (9:7). 

The  Logistics  Management  Institute  (LMI)  proposed 
to  determine  the  relationships  among  system  and  subsystem 
reliability  and  life  cycle  costs.  This  model  used  three 
principle  model  parameters.  These  are:  (1)  cost  of  system 
downtime  (costs  to  achieve  constant  mission  requirements) ; 
(2)  design,  development,  test,  acquisition,  and  program 


management  costs  associated  with  achieving  reliability;  and 
(3)  maintenance  and  support  costs  affected  by  subsystem 
reliability  (17:8). 

Limitations  of  Existing  Models 

The  Arms  model  and  LMI  model,  as  did  other  models 
studied,  used  reliability  as  an  input  required  to  determine 
other  system  parameters,  such  as  availability,  manpower 
requirements,  or  LCCs.  Most  significantly,  these  computer 
models  did  not  include  the  closed-loop  information  feedback 
system.  By  not  including  this  information  feedback  system, 
the  model  failed  to  capture  the  system  structure  that  was 
being  studied,  and  did  not  show  how  other  system  parameters 
affected  reliability.  A  closed-loop  information  feedback 
system  is  generated  whenever  an  action  affects  the  environ¬ 
ment,  and  that  action  subsequently  influences  future  deci¬ 
sions  about  the  environment  (8:14). 

Additional  limitations  in  computer  models  were 
identified  by  Joint  AFSC/AFLC  Commander's  Working  Group  on 
Life  Cycle  Cost.  This  group  concluded  that: 

1.  The  models  are  too  complex. 

2.  The  requirements  for  input  data  frequently  can¬ 
not  be  fulfilled. 

3.  The  models  are  not  sensitive  to  the  relation¬ 
ships  between  design  and  performance. 
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4.  The  models  are  not  sensitive  to  failures  caused 


by  the  increasing  age  and  wear  of  a  system  (10:8). 

Improvements  are  being  made  in  computer  models,  but 
all  of  the  limitations  identified  above  still  exist  (7:6). 

The  final  limitation  to  be  discussed  is  the  failure 
of  existing  models  to  consider  how  policy  and  management 
structure  changes  may  affect  a  system.  Too  often,  policy 
and  management  considerations  are  brushed  aside  as  given  or 
preconsidered  assumptions  and  are  not  identified  as  vari¬ 
ables  that  may  have  the  greatest  effect  on  system  behavior 
(7:6-7)  . 

The  next  section  will  provide  insight  into  some  of 
the  capabilities  and  techniques  of  system  dynamics  by 
briefly  describing  how  properly  constructed  system  dynamics 
models  can  correct  the  deficiencies  of  existing  models. 
Managerial  Applications  of  System  Dynamics  by  Roberts  con¬ 
tains  examples  of  system  dynamics  models  that  have  been 
implemented  in  a  variety  of  situations. 

System  Dynamics  Modeling 

Including  excessive  detail  which  results  in  a  highly 
complex  model  can  be  a  serious  problem  in  a  system  dynamics 
model,  just  as  it  is  in  existing  models.  Variables  are 
often  left  in  models  to  avoid  discriminating  thinking  about 
whether  or  not  the  variables  actually  contribute  to  system 
performance.  Some  detail,  even  if  it  does  not  affect  system 


performance,  can  be  justified  as  providing  an  apparent 
reality  to  the  model.  This  apparent  reality  makes  the 
model  easier  to  explain  to  the  managers  who  will  use  the 
model.  The  skill  that  the  builder  brings  to  the  modeling 
process  determines  whether  a  model  becomes  too  complex  or 
oversimplified  (8:453). 

A  system  dynamics  model  does  not  require  large 
quantities  of  statistical  data  to  be  effective.  In  system 
dynamics,  the  model  is  based  upon  actual  system  structure 
and  is  subsequently  used  to  determine  what  formal  data 
needs  to  be  collected  (8:57).  It  can  usually  be  determined 
if  the  actual  value  of  the  data  must  fall  within  a  certain 
range.  Estimates  of  the  numeric  values  to  be  used  in  the 
model  are  made.  The  model  is  then  used  to  determine  the 
sensitivity  of  the  system  to  changes  in  these  values. 

Often  the  model  is  relatively  insensitive  to  changes  in 
values  within  the  estimated  range,  and  expending  resources 
to  refine  the  estimate  would  be  unjustified.  If  the  model 
shows  that  the  entire  qualitative  behavior  of  the  system 
depends  on  a  numerical  value  that  was  estimated,  then  this 
value  must  be  measured  with  adequate  accuracy.  The  main 
point  is  that  a  mathematical  model  should  be  based  on  the 
best  information  available,  just  as  management  decisions 
are  based  on  the  best  information  available.  The  design 
and  use  of  a  model,  however,  should  not  be  postponed  until 
all  pertinent  parameters  have  been  accurately  measured. 
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Values  should  be  estimated  when  necessary  to  enable  the 
model  to  be  put  into  productive  use  (8:58).  Forrester 
summarized  his  views  on  data  as  follows: 

Dynamic  models  will  be  based  primarily  on  our 
descriptive  information  already  available,  not  on  sta¬ 
tistical  data  alone.  Observation  of  and  familiarity 
with  a  system  will  reveal  actions,  motivations,  and 
information  sources  that  cannot  be  discovered  through 
historically  available  quantitative  measures  [8:130]. 

A  system  dynamics  model  must  describe  the  cause- 
effect  relationships  that  exist  in  a  system  (8:67),  such 
as  the  relationship  between  design  and  performance  param¬ 
eters.  These  cause-effect  relationships  can  be  mapped  onto 
a  system  dynamics  model  through  a  structure  of  levels,  which 
are  interconnected  by  controlled  flows  (8:67).  The  levels 
are  accumulations  within  the  system  (8:68).  Examples  of 
levels  within  an  aircraft  weapon  system  are  the  number  of 
trained  crews  available  to  operate  the  aircraft  in  the 
inventory,  the  number  of  aircraft  in  the  inventory,  or  the 
amount  of  flying  hours  available  to  fly  these  aircraft. 
Controlled  flows  emerge  from  these  levels.  The  controlled 
flows  are  made  up  of  the  flows  that  transfer  the  contents 
of  one  level  to  another  level  and  the  decision  functions 
that  control  the  rates  of  flows  between  levels.  The  rates 
correspond  to  an  activity  within  a  system,  while  the  levels 
measure  the  state  to  which  the  system  has  been  brought. 

The  decision  functions  are  the  policy  statements  that  deter¬ 
mine  how  the  available  information  about  the  system  state 
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(a  level)  leads  to  a  decision  (a  rate)  resulting  in  a 
change  to  the  system  (a  flow  from  one  level  to  another) 
(8:68-69) . 

For  example,  there  may  be  twenty  crews  (level) 
available  to  fly  twenty  aircraft.  Policy  may  require  two 
crews  for  every  aircraft.  This  policy  leads  to  a  decision 
(a  rate)  which  causes  additional  crews  to  be  trained  (a 
flow  or  activity)  until  forty  crews  are  available  (a  new 
level)  . 

A  system  dynamics  model  is  a  network  of  these 
levels  and  rates  which  are  interconnected  by  an  information 
network.  The  information  network  is  also  a  sequence  of 
alternating  rates  and  levels  (8:71).  System  dynamics  model 
structure  is  simple  and  straightforward.  The  structure 
permits  a  one-to-one  correspondence  between  the  model  and 
the  system  being  represented  (8:131). 

System  dynamics  is  aimed  at  modeling  dynamic  sys¬ 
tems  which  tend  to  evolve  over  a  period  of  time  (14:xx). 
Aircraft  accumulate  more  hours  and  more  sorties  which 
illustrates  a  type  of  time-varying  behavior,  which  can  be 
modeled  using  the  system  dynamics  concepts  of  levels  and 
flows  already  explained  (8:50).  Aircraft  in  maintenance 
can  be  thought  of  as  a  level  into  which  aircraft  flow  after 
flying  a  mission.  The  rate  at  which  these  aircraft  flow 
into  maintenance  is  a  function  of  how  many  sorties  are 
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flown.  As  more  sorties  are  flown,  more  aircraft  flow  into 
maintenance. 

The  last  deficiency  of  existing  models  concerns  the 
absence  of  specific  ability  to  capture  the  policies  and 
structure  of  the  system.  By  failing  to  capture  the  struc- 
ture  of  the  system,  these  models  failed  to  reproduce  or  pre¬ 
dict  the  behavior  characteristics  of  the  system.  Character¬ 
istics  such  as  stability,  oscillation,  growth,  and  general 
time  relationships  between  variables  are  required  to  under¬ 
stand  the  system  and  to  make  changes  for  system  improvement 
(8:54)  . 

In  general,  system  dynamics  modeling  has  two  objec¬ 
tives  : 

1.  Explaining  the  system's  behavior  in  terms  of  its 
structure  and  policies. 

2.  Suggesting  changes  to  structure,  policies,  or  both, 
which  will  lead  to  improvement  in  the  behavior 
(6:19] . 

Thus  a  system  dynamics  model  is  created  to  enhance  the 
understanding  of  the  policy  and  structure  of  a  system,  the 
very  two  elements  that  are  left  out  of  most  other  models. 

Throughout  this  chapter,  basic  concepts  and  tech¬ 
niques  of  system  dynamics  have  been  introduced  to  show  how 
system  dynamics  overcomes  many  of  the  problems  faced  by 
managers  trying  to  manage  complex  organiztions.  It  is 
appropriate  now  to  summarize  these  concepts  and  techniques 
by  providing  the  basic  premises  of  system  dynamics  modeling. 
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1.  Decisions  in  management  and  economics  take 
place  in  a  framework  that  belongs  to  the  general  class  known 
as  information  feedback  systems. 

2.  Intuitive  judgment  is  unreliable  about  how  these 
systems  will  change  with  time,  even  with  good  knowledge  of 
the  individual  parts  of  the  system. 

3.  Model  experimentation  is  now  possible  to  fill 
the  gap  where  judgment  and  knowledge  are  weakest--by  showing 
the  way  in  which  known  separate  system  parts  can  interact  to 
produce  unexpected  and  troublesome  overall  system  results. 

4.  Enough  information  is  available  for  this  experi¬ 
mental  model-building  approach,  without  great  expense  and 
delay  in  further  data  gathering. 

5.  The  "mechanistic"  view  of  decision  making 
implied  by  such  model  experiments  is  true  enough,  so  that 
the  main  structure  of  controlling  policies  and  decision 
streams  of  an  organization  can  be  represented. 

6.  Systems  are  constructed  internally  in  such  a 
way  that  the  system  creates  many  of  the  troubles  that  are 
often  attributed  to  outside  and  independent  causes. 

7.  Policy  and  structure  changes  that  will  produce 
substantial  improvement  in  system  behavior  are  feasible  and 
system  performance  is  far  from  what  it  can  be.  Initial 
system  design  changes  can  improve  all  factors  of  interest 
without  a  compromise  that  causes  losses  in  one  area  in 
exchange  for  gains  in  another  (8:13-14). 
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Summary 

In  this  background  section,  it  was  shown  that  the 
concept  of  reliability  as  part  of  a  total  system  is  only 
beginning  to  be  understood  by  managers.  The  limitations 
of  existing  models  do  not  allow  managers  to  effectively 
control  the  reliability  of  a  system.  System  dynamics  does 
provide  a  framework  whereby  the  reliability  of  a  system  can 
be  analyzed,  and  improvements  can  be  made  to  enhance  a 
system’s  reliability.  The  research  questions  derived  from 
the  problem  statement  and  background  are  presented  next. 

Research  Objectives 

The  objective  of  this  research  is  to  develop  a  model 
of  the  dynamic  system  determining  the  reliability  of  air¬ 
craft  weapon  systems.  Specific  objectives  are: 

1.  To  identify  the  most  significant  internal  and 
external  forces  affecting  reliability  of  an  aircraft  weapon 
system. 

2.  To  identify  the  cause-effect  relationships  and 
information  feedback  loops  that  control  reliability. 

3.  To  construct  a  model  which  represents  the 
forces,  relationships,  information  flows,  and  decision  poli¬ 
cies  of  the  reliability  system. 

4.  To  develop  management  policies  which  make 


possible  more  effective  control  of  reliability. 


5.  To  provide  knowledge  that  data  collection 
designers  need  to  measure  reliability. 

6.  To  provide  an  improved  conceptualization  of 
reliablity  for  other  researchers  to  use  to  define  the 
reliability  system. 


Research  Questions 

1.  What  are  the  relationships  between  reliability 
and  other  components  of  a  system  which  affect  the  total 
reliability  of  a  weapon  system? 

2.  Can  a  conceptualization  of  the  interrelation¬ 
ships  between  the  reliability  of  a  system  and  the  other 
components  of  the  system  be  developed  and  used  as  the  basis 
for  a  mathematical  computer  simulation  model? 

3.  Can  the  developed  model  function  as  a  manage¬ 
ment  tool,  whereby,  managers  can  determine  the  effect  that 
proposed  changes  in  other  system  components  have  on  relia¬ 
bility? 


Summary 

In  this  chapter  a  new  concept  of  reliability  has 
been  advanced.  The  research  was  designed  to  refine  and 
present  this  concept  through  the  development  of  an  opera¬ 
tional  model,  which  can  be  used  by  managers.  An  analysis  of 
the  current  situation  concerning  reliability  was  presented. 
This  analysis  led  to  the  problem  statement  that  the  vari¬ 
ables,  which  affect  the  reliability  of  aircraft  weapon 
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systems  are  not  adequately  understood  by  DOD  managers.  The 
background  section  discussed  some  current  management  think¬ 
ing  about  reliability.  This  section  also  identified  the 


difficulties  managers  faced  when  trying  to  deal  with  complex 
interactions,  such  as  interactions  between  reliability  and 
other  components  of  a  system.  A  review  of  existing  models 
pointed  out  both  capabilities  and  limitations.  System 
dynamics  was  introduced  and  suggested  as  a  technique  which 
would  be  a  valuable  tool  to  aid  managers  in  overcoming  many 
of  these  limitations  found  in  existing  models.  The  chapter 
concluded  with  the  research  objectives  and  research  ques¬ 
tions  . 

In  Chapter  II,  a  methodology  of  the  system  dynamics 
paradigm  will  be  presented.  Each  individual  procedure  will 
be  explained,  and  an  example  will  be  provided.  Chapter  III 
will  present  the  construction  of  the  system  structure 
through  the  use  of  causal  loop  diagrams.  In  Chapter  IV, 
flow  diagramming  and  DYNAMO  equations  will  be  presented 
along  with  explanations  of  how  the  diagrams  and  equations 
were  formed  and  why  they  are  included  in  the  model. 

Chapter  V  will  contain  an  analysis  of  two  management  con¬ 
cepts  and  show  how  these  concepts  affect  the  operational 
reliability  of  the  aircraft  weapon  system. 


CHAPTER  II 


METHODOLOGY 

Introduction 

Described  in  this  chapter  is  the  system  dynamics 
paradigm  as  applied  to  the  analysis  of  reliability.  The 
first  section  discusses  model  design  procedures.  Detailed 
explanations  of  each  of  these  procedures  will  follow, 
describing  how  the  model  of  aircraft  weapon  system  relia¬ 
bility  will  be  developed.  Validation  and  analysis  of  this 
model  will  then  be  covered.  In  this  section  some  of  the 
limitations  of  the  validation  process  will  be  discussed. 

The  chapter  will  conclude  with  a  final  section  summarizing 
this  chapter  and  outlining  the  direction  the  final  chapters 
of  the  thesis  will  follow. 

Model  Design  Procedures 

To  construct  a  dynamic  simulation  model  of  the 
reliability  of  a  weapon  system,  six  steps  have  been  iden¬ 
tified. 

1.  Identify  the  system  and  the  sectors  of  the  sys¬ 
tem  to  be  studied.  Determine  if  a  dynamic  system  oriented 
investigation  is  warranted. 

2.  Draw  causal  loop  diagrams  showing  the  inter¬ 
action  of  the  system's  variables. 
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3.  Develop  a  mathematical  model  of  the  system  by: 

a.  Converting  the  causal  loop  diagrams  into 
detailed  flow  diagrams  and; 

b.  Converting  the  detailed  flow  diagrams  into 
DYNAMO  mathematical  equations. 

4.  Generate  over  time,  through  the  use  of  the  com¬ 
puter,  the  behavior  of  the  modeled  system  to  validate  that 
the  model  reasonably  represents  the  system  under  study. 

5.  Conduct  simulation  experiments  to  determine 
those  variables  within  the  system  that  are  sensitive  to 
changes . 

6.  Incorporate  redesigned  system  parameters  into 
the  model,  followed  by  computer  runs,  to  determine  the 
effect  the  changes  have  on  the  system  behavior.  From  these 
simulation  experiments,  recommend  changes  to  the  system  that 
improve  system  performance  or  identify  areas  that  need  addi¬ 
tional  study  (14:xx-xxi). 

What  follows  are  brief  descriptions  of  the  stages 
of  the  system  dynamics  process  as  they  relate  to  the  reli¬ 
ability  of  a  weapon  system. 

Identify  the  System 

The  first  stage  in  developing  a  system  dynamics 
model  is  to  identify  the  system  and  determine  if  a  system- 
oriented  investigation  is  warranted.  The  fact  that  the 
reliability  of  a  weapon  system  deserves  a  system  dynamics 
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study  has  already  been  discussed  in  Chapter  I.  System 
sectors  are  identified  to  provide  a  conceptual  framework 
through  which  the  model  structure  is  developed  (6:24). 
Determining  the  appropriate  system  sectors  to  include  in 
the  model  requires  considerable  analysis  and  the  final  deci¬ 
sion  of  what  should  or  should  not  be  included  in  the  system 
sectors  rests  with  the  model  builders.  The  sectors  selected 
for  this  model  are  Maintenance,  Operations,  and  Research 
and  Development.  Relationships  between  and  within  sectors 
are  defined  by  interconnected  networks  of  material,  require¬ 
ments,  money,  personnel,  capital  equipment,  and  information 
which  flow  among  sectors.  Figure  2-1  is  an  example  of  the 
overall  system  sector  diagram  illustrating  how  the  network 
of  flows  connect  the  sectors. 

MATERIAL 


Pig.  2-1.  System  Sector  Relationship 

The  Operations  Sector  controls  the  operational 
aspect  of  the  reliability  model.  In  the  Operations  Sector, 
aircraft  are  scheduled  and  flown  in  terms  of  sorties. 

These  sorties  constitute  the  operational  reliability  of 
the  aircraft  weapon  system.  The  activity  in  the  Operations 
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Sector  generates  aircraft  for  the  Maintenance  Sector.  The 
Maintenance  Sector  services  and  restores  the  aircraft  to 
operational  status,  and  these  aircraft  are  again  available 
for  operational  use.  The  Research  and  Development  Sector 
provides  aircraft  with  improved  reliability  and  maintain¬ 
ability  through  increases  in  its  technological  base.  The 
sector  descriptions  and  interactions  will  be  explained  in 
greater  detail  in  the  chapters  on  causal  loops  and  flow 
diagram  analysis. 


Causal  Loop  Diagrams 

Causal  loop  diagrams  extend  the  concepts  made 
explicit  in  the  sector  diagrams  by  identifying  the  variables 
and  the  pairwise  relationships  of  these  variables  within 
system  sectors.  The  causal  loops  also  provide  the  relation¬ 
ships  or  links  between  system  sectors.  In  other  words, 
the  causal  loop  diagrams  record  the  way  the  system  works 
(6:63).  First  an  explanation  of  the  symbology  and  construc¬ 
tion  of  causal  loops  is  provided. 

The  symbology  used  in  causal  loop  diagrams  is 
straightforward.  Arrows  identify  the  causal  link  with  the 
direction  of  the  arrow  indicating  the  direction  of  the 
cause-effect  relationship.  The  polarity  of  the  causal  link 
is  indicated  by  a  ♦  and  -  sign.  The  ♦  indicates  a  positive 
link,  and  the  -  indicates  a  negative  link.  The  polarity  is 
determined  by  considering  the  effects  a  change  in  the 


25 


variable  at  the  tail  of  the  arrow  would  have  on  the  vari¬ 


able  at  the  head  of  the  arrow.  The  rule  is:  if  the  head 
variable  changes  in  the  same  direction  as  the  tail  vari¬ 
able,  the  link  is  positive:  if  the  head  variable  changes 
in  the  opposite  direction  of  the  tail  variable,  the  link 
is  negative  (6:63).  Figure  2-2  provides  an  example. 


Aircraft  Aircraft 

Availability  - >  Sorties 


Positive  Link 


Aircraft  in 
Maintenance 


Aircraft 

>  Availability 


Negative  Link 


Fig.  2-2.  Causal  Link  Example 


By  combining  causal  links,  complete  loops  are  formed. 
The  polarity  of  the  loop  is  determined  by  counting  the  num¬ 
ber  of  negative  pairwise  relationships.  An  even  number  of 
negative  links  or  no  negative  links  produces  a  positive 
loop.  Figure  2-3  provides  examples  of  causal  loop  diagrams. 

The  negative  causal  loop  is  interpreted  as  follows. 

As  the  maintenance  on  the  aircraft  goes  up,  the  availability 
of  the  aircraft  goes  down — a  negative  link.  As  the  avail¬ 
ability  of  the  aircraft  goes  up,  the  operational  use  of  the 
aircraft  goes  up — a  positive  link.  There  is  one  negative 
link  which  means  the  causal  loop  has  negative  polarity. 

This  causal  loop  indicates  the  more  the  aircraft  are  flown 
the  more  maintenance  is  required  and  the  less  the  aircraft 
are  available  for  use. 
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Fig.  2-3.  Causal  Loop  Example 


The  first  link  in  the  positive  causal  loop  is  inter¬ 
preted  the  same  as  in  the  negative  causal  loop.  New  vari¬ 
ables  have  been  included  which  changed  the  polarity  of  the 
causal  loop.  As  the  availability  of  aircraft  goes  up,  the 
operational  reliability  of  the  aircraft  goes  up,  a  positive 
link.  As  the  operational  reliability  goes  up,  the  require¬ 
ment  for  maintenance  goes  down,  a  negative  link.  As  the 
requirement  for  maintenance  goes  up,  the  maintenance  of  air¬ 
craft  goes  up,  a  positive  link.  There  are  two  negative 
links  which  means  the  causal  loop  has  a  positive  polarity. 
This  causal  loop  indicates  the  more  operational  reliability 
the  less  maintenance  required  which  results  in  more  avail¬ 
ability  and  more  operational  reliability. 

Negative  loops  contain  a  control  mechanism  which 
attempts  to  regulate  the  system  (6:40).  Positive  loops 
tend  to  promote  uncontrolled  growth  or  decay  (6:38-39). 
Although  the  causal  loop  diagram  is  very  useful  for  model 
building,  it  is  necessary  to  draw  a  detailed  flow  diagram 
in  the  programming  stage  (6:113).  These  flow  diagrams  are 
discussed  in  the  following  section. 

Flow  Diagrams 

The  derivation  of  the  flow  diagramming  process 
comes  from  the  study  of  the  system  and  is  based  on  the 
causal  loop  diagrams  previously  discussed.  The  symbology 
used  in  flow  diagrams  is  depicted  in  Figure  2-4.  The  flow 
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Levels--measurable  quantities  or 
accumulations  within  the 
system 


Flows — movements  of: 


information 

material 

money 

personnel 

capital 

equipment 


- -> 

- > 

- « - > 

~  9 


Decision  Function  (RATE) — controls 
flows  between  levels 


o 


Source/Sink — represents  levels 
outside  the  system 


Auxiliary  Variable — provides 
greater  meaning  to  decision 
function  variables  (goals,  policies) 


Parameter — a  constant 


Delay — describes  the  process  of 
time  delays 


Fig.  2-4.  Flow  Diagram  Symbols  (8  :82-84) 
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diagram  represents  the  concept  of  levels  and  rates 
explained  in  Chapter  I.  Figure  2-5  provides  an  example 
which  shows  how  the  level  of  aircraft  availability  (AA) 
is  controlled  by  the  aircraft  repair  rate  (ARR) .  The  air¬ 
craft  repair  rate  is  a  function  of  the  number  of  aircraft 
in  maintenance  (AM)  and  the  aircraft  repair  factor  (ARF) . 
Various  support  factors  enter  this  repair  factor  and  will 
be  explained  in  greater  detail  when  the  complete  flow  dia¬ 
gram  analysis  is  presented.  The  mathematical  equations  are 
derived  directly  from  the  flow  diagrams. 

Equations 

The  developed  equations  will  become  the  basis  for 
the  DYNAMO  computer  simulation  model  of  reliability.  The 
five  classes  of  equations  in  DYNAMO  are  level,  rate, 
auxiliary,  supplementary,  and  initial  value.  Level,  rate, 
and  auxiliary  equations  have  time  dimensions.  Successive 
points  in  time  are  given  the  designations  J,  K,  and  L.  The 
letter  J  denotes  the  past,  the  letter  K  denotes  the  present, 
and  the  letter  L  denotes  the  future.  The  notation  used 
in  the  equations  is  similar  to  subscripting.  An  example 
from  Figure  2-5  shows  a  level  at  the  present  time  (AA.K) . 
Levels  have  only  a  single  letter  as  a  time  suffix  because 
the  values  of  levels  are  calculated  at  separate  instants 
of  time.  Rates,  which  define  the  flows  between  levels, 
use  two  letters  to  denote  the  flow  from  the  present  time  (K) 
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AIRCRAFT  IN 
MAINTENANCE 


AIRCRAFT 

AVAILABILITY 


Fig.  2-5.  Flow  Diagram  Example 
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to  a  future  time  (L) ,  for  example,  ARR.KL.  The  ARR.JK< 
symbol  would  be  used  to  denote  a  flow  from  the  past  time 
(J)  to  the  present  time  (K)  (8:75-79). 

The  value  of  a  level  is  a  function  of  the  .prior 
level  and  rate  at  which  the  level  is  changing  over  the  -last 
time  period  (DT) .  For  example, 

AA.K-AA. J+DT* (ARR. JK) 

Rates  are  normally  functions  of  levels  or  auxiliary 
variables,  but  they  can  also  be  a  constant  value.  For 
example, 

ARR. KL»AM. K*ARF . K 

where  AM  is  the  present  level  of  maintenance  and  ARF  is  the 
aircraft  repair  factor,  a  fraction. 

Auxiliary  equations  are  used  to  decompose  rate 
equations.  The  auxiliary  equations  allow  the  model  to  be 
kept  in  close  correspondence  with  the  actual  system,  since 
the  auxiliary  can  be  used  to  define  the  many  factors  that 
go  into  making  up  a  rate. 

Initial  value  equations  define  initial  values  of 
all  levels  (and  some  rates)  that  must  be  given  before  the 
first  simulation  run. 

Supplementary  equations  are  used  to  define  vari¬ 
ables  which  are  used  in  the  printing  and  plotting  of  model 
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values.  Supplementary  equations  are  not  used  in  computing 
any  values  that  affect  the  behavior  of  the  system  (8:79). 

The  equations  developed  for  the  simulation  model 
are  then  verified.  To  verify  the  model,  DYNAMO  equations 
are  compared  to  the  flow  diagrams  and  checked  to  ensure  the 
equations  do,  in  fact,  represent  the  system  as  defined  by 
the  flow  diagrams.  Verification  is  performed  to  insure  that 
the  model  is  in  fact  what  the  modeler  intended  it  to  be. 
Having  explained  how  the  model  is  formulated,  model  vali¬ 
dation  and  analysis  will  be  discussed  next. 

Model  Validation  and  Analysis 

Model  validation  does  not  mean  that  the  model  will 
be  proven.  In  this  thesis,  model  validation  is  the  process 
by  which  sufficient  confidence  is  established  to  use  the 
model  for  a  particular  purpose  (6:181).  Coyle  stated 
".  .  .  there  are  no  such  things  are  models  which  are 
absolutely  valid  or  completely  invalid  (6:182)."  Valida¬ 
tion  of  this  model  will  consist  of  determining  if  the  model 
reproduces  system  behavior. 

Part  of  the  validation  has  been  accomplished 
through  the  knowledge  gained  from  the  literature  review  and 
the  experience  of  the  model  builders.  Statistical  data 
were  obtained  from  system  effectiveness  reports  and  com¬ 
bined  to  form  an  aggregate  input  into  the  model.  This 
input  represents  as  nearly  as  possible  the  operational 
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environment  that  the  model  builders  are  trying  to  simulate. 
The  limitations  of  this  validation  process  are  (1)  reliance 
on  expert  opinion  and  (2)  lack  of  quantifiable  data  for 
the  many  variables  included  in  the  model.  Serious  model 
defects  will  usually  expose  themselves  through  some  failure 
of  the  model  to  perform  as  would  be  expected  of  the  actual 
system.  If  the  model  does  not  have  any  serious  defects 
then  the  validated  model  becomes  a  management  tool  to  con¬ 
duct  simulation  experiments.  In  effect  the  model  becomes  a 
management  laboratory  (8:vii). 

The  reliability  of  the  aircraft  weapon  system  will 
be  analyzed  by  entering  two  management  concepts  into  the 
model.  The  first  concept  is  the  decision  to  improve  train¬ 
ing  and  technical  data  in  order  to  improve  personnel  output. 
The  second  management  concept  to  be  considered  is  the  reduc¬ 
tion  of  maintenance  levels  from  three  levels  to  two  levels. 
Further  discussion  of  this  analysis  will  be  included  in  the 
final  chapter. 


Summary 

In  this  chapter,  the  methodology  of  the  research 
effort  was  presented.  The  system  dynamics  paradigm  was 
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discussed  as  well'  as  a  detailed  explanation  of  the  causal 
loop  diagrams,  flow  diagrams,  and  DYNAMO  equations.  Through 
the  use  of  these  techniques,  the  reliability  model  will  be 
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developed.  In  Chapter  III,  a  step-by-step  discussion  of  the 
relationships  within  each  sector  will  be  explained. 


CHAPTER  III 


CAUSAL  LOOP  DESCRIPTIONS 

Introduction 

This  chapter  continues  the  conceptualization  of  the 
operational  reliability  model.'  The  conceptual  model  develop* 
ment  began  in  Chapters  I  and  II  at  the  highest  level  of 
abstract  thinking,  that  is,  at  the  apex  of  what  Beer  calls 
the  "cones  of  resolution.”  These  cones  of  resolution  can 
be  thought  of  as  a  thoroughness-abstraction  hierarchy  of 
models.  At  the  top  of  the  hierarchy  is  a  very  abstract 
model.  At  the  bottom  of  the  hierarchy  is  a  very  detailed 
and  thorough  model.  Each  succeeding  level  of  resolution  or 
model  in  the  hierarchy  contains  additional  details  not 
found  in  the  previous  level  (16:247-248).  The  operational 
reliability  model  development  follows  this  hierarchical 
process.  The  causal  loop  diagrams  in  this  chapter  will 
provide  more  detail  to  the  conceptual  model  already  devel¬ 
oped.  The  flow  diagrams  and  equations  in  Chapter  IV  will 
further  enrich  the  model  and  move  it  lower  on  the  cone  of 
resolution.  The  intent  is  to  provide  sufficient  detail  to 
make  the  model  meaningful  to  policy  makers  at  the  Head¬ 
quarters  USAF  level.  Thus,  the  model  will  be  looking  at 
total  aircraft  operational  reliability  within  USAF  and  not 
at  a  particular  weapon  system.  All  the  variables  used  in 
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the  model  will  be  at  this  same  level  of  resolution  (for 
example,  total  aircraft  inventory,  total  maintenance  per¬ 
sonnel,  etc.). 

The  causal  loop  diagrams  continue  the  conceptuali¬ 
zation  of  the  model  by  depicting  the  relationships  among 
the  variables  in  the  three  sectors  of  the  model  (Operations 
Maintenance,  and  Research  and  Development) .  Causal  loop 
diagrams  provide  a  visual  description  to  aid  in  the  initial 
understanding  of  the  system  and  are  also  of  great  value  in 
discussing  the  system  with  the  manager.  Each  sector  will 
be  explained  through  a  step-by-step  development  of  the 
pairwise  relationships  between  variables  within  each  sector 
These  pairwise  relationships  will  be  combined  to  form  the 
complete  causal  loop  diagram  for  the  system. 

Operations  Sector 

The  Operations  Sector  is  an  essential  part  of  the 
reliability  system  because  it  provides  the  ultimate  test 
of  the  operational  reliability  of  the  system.  For  example, 
if  a  designated  bomber  does  not  hit  its  target,  the  system 
is  not  reliable.  The  causes  of  the  failure  might  range 
from  an  inherent  reliability  problem  of  the  equipment  to 
the  inexperience  of  the  crew.  In  the  Operations  Sector, 
the  model  attempts  to  capture  the  idea  of  coordinating  the 
essential  variables  into  one  unit  so  that  the  aircraft 
weapon  system  is  able  to  perform  its  assigned  mission. 
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Three  important  variables  identified  in  this  model 
are:  (1)  aircraft  availability  (AA) ,  (2)  crew  availability 
(CA) ,  and  (3)  flying  hour  availability  (FHA) .  The  weapon 
system  cannot  operate  unless  all  three  variables  are  acces¬ 
sible.  These  three  variables  determine  the  number  of  ' 
sorties  scheduled  (SS)  as  depicted  in  Figure  3-1. 

Aircraft 
Availability 
(AA) 

Crew 

Availability 
(CA) 

Flying  Hour 
Availability 
(FHA) 

Fig.  3-1.  Aircraft  Availability,  Crew  Availability, 
and  Flying  Hours  Availability  to  Scheduled 
Sortie  Relationship 

There  is  a  positive  relationship  between  the  three  vari¬ 
ables  and  sorties  scheduled  because  as  the  availability  of 
these  resources  increases,  scheduled  sorties  increase. 

As  the  number  of  scheduled  sorties  increases,  the 
number  of  potential  successful  sorties  (SUCS)  also  increases 
giving  the  relationship  a  positive  influence.  This  rela¬ 
tionship  is  shown  in  Figure  3-2. 


Scheduled  Sorties 
(SS) 


+  Successful  Sorties 

- >  (SUCS) 


Fig.  3-2.  Scheduled  Sorties  to  Successful 
Sortie  Relationship 
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Successful  sorties  are  also  influenced  by  the  sortie 
abort  rate  (SAR) .  There  is  a  negative  relationship  between 


these  two  variables.  As  the  sortie  abort  rate  increases, 
the  number  of  successful  sorties  decreases.  This  relation¬ 
ship  is  shown  in  Figure  3-3. 

Sortie  Abort  Rate  -  Successful  Sorties 

(SAR)  - >  (SUCS) 

Fig.  3-3.  Sortie  Abort  Rate  to  Successful 
Sortie  Relationship 

Successful  sorties  influence  the  flying  hours  avail¬ 
able  and  crews  available.  As  more  successful  sorties  are 
flown  there  are  less  flying  hours  available  and  crews  avail¬ 
able,  thus  creating  negative  relationships  between  these 
variables.  These  pairwise  relationships  are  depicted  in 
Figure  3-4. 


Successful  Sorties 
(SUCS) 


Crew  Availability  (CA) 

Flying  Hour  Availability 
(FHA) 


Fig.  3-4.  Successful  Sorties  to  Crew  Availability 
and  Flying  Hour  Availability  Relationship 

Successful  sorties  also  influence  the  number  of  air¬ 
craft  in  maintenance  (AM)  because  of  the  servicing  involved 
and  repairs  made  on  other  than  mission  essential  equipment. 
Aircraft  available  (AA)  are  a  product  of  the  maintenance 
sector  and  will  be  discussed  in  that  section.  The 
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relationship  between  successful  sorties  and  aircraft  in 
maintenance  is  shown  in  Figure  3-5. 


Successful  Sorties 
(SUCS) 


Aircraft  in 
♦  ^  Maintenance 
(AMI 


Fig.  3-5.  Successful  Sorties  to  Aircraft  in 
Maintenance  Relationship 


A  performance  measure  of  the  Operations  Sector  is 
the  number  of  successful  sorties.  The  management  of  the  key 
variables  of  aircraft  availability,  crew  availability,  and 
flying  hour  availability  determine  the  number  of  successful 
sorties  that  can  be  supported  by  the  Operations  Sector. 

The  number  of  successful  sorties  can  be  compared  with  the 
measures  in  the  other  sectors,  such  as  aircraft  in  mainte¬ 
nance  and  relative  number  of  engineers  to  give  an  overall 
view  of  reliability.  The  Operations  Sector  is  summarized 
in  the  causal  loop  diagram  in  Figure  3-6. 


Sortie  Abort 
Rate 


Aircraft 

Availability 


Fig.  3-6.  Operations  Sector  Causal  Loop  Diagram 
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Maintenance  Sector 


In  the  Maintenance  Sector,  the  restoration  and 
servicing  of  aircraft  is  performed.  The  two  key  variables 
in  the  Maintenance  Sector  are  aircraft  availability  and 
aircraft  in  maintenance.  A  production  line  is  created 
between  these  two  variables,  because  aircraft  are  either 
in  available  status  or  maintenance  status.  The  aircraft 
repair  rate  (ARR)  and  the  aircraft  into  maintenance  rate 
(AIMR)  determine  what  status  the  aircraft  are  in.  There 
are  also  four  factors  that  affect  the  repair  rate.  These 
factors  are  personnel  capability,  equipment  capability, 
supply  capability,  and  facilities  capability.  These  four 
factors  can  be  considered  a  consolidation  of  the  Integrated 
Logistics  Support  System.  The  consolidation  was  made  to 
simplify  the  model,  while  still  retaining  the  essential 
features  of  the  actual  system  being  modeled.  These  factors 
determine  the  aircraft  repair  rate  (ARR)  and  are  illustrated 
in  Figure  3-7. 

Personnel  Capability  (PA) 

Equipment  Capability  (EC) 

Supply  Capability  (SC) 

Facilities  Capability  (FC) 

Fig.  3-7.  Personnel  Capability,  Equipment 
Capability,  Supply  Capability,  and 
Facilities  Capability  to  Aircraft 
Repair  Rate  Relationship 
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There  is  a  positive  relationship  between  these  factors  and 
the  aircraft  repair  rate,  because  as  the  capabilities 
increase,  the  aircraft  repair  rate  also  increases. 


The  aircraft  repair  rate  has  a  negative  relation¬ 
ship  with  aircraft  in  maintenance.  As  the  aircraft  repair 


rate  increases,  the  number  of  aircraft  in  maintenance 


decreases.  The  causal  diagram  is  in  Figure  3-8 


Aircraft  Repair  Rate 
(ARR) 


Aircraft  in  Maintenance 
(AM) 


Fig.  3-8.  Aircraft  Repair  Rate  to  Aircraft 
in  Maintenance  Relationship 


As  the  aircraft  in  maintenance  decrease,  the  air 


craft  available  increase,  making  this  a  negative  pairwise 
relationship.  The  causal  diagram  is  in  Figure  3-9. 


Aircraft  in  Maintenance 
(AM) 


Aircraft  Availability 
(AA) 


3-9.  Aircraft  in  Maintenance  to  Aircraft 
Availability  Relationship 


The  number  of  aircraft  in  maintenance  also  has  an 


influence  on  the  capability  factors  mentioned  above.  As 
the  number  of  aircraft  in  maintenance  increase,  the  capa¬ 
bility  of  the  four  factors  decrease,  creating  negative  rela 
tionships.  This  is  because  there  is  a  finite  capability 
existing  in  each  element.  As  a  portion  of  this  finite 
capability  is  consumed,  less  capability  exists  to  repair 
other  aircraft.  The  practical  effect  of  this  relationship 


is  that  there  is  a  maximum  repair  rate  and  as  the  system 
approaches  this  maximum,  there  is  little  surge  capability 
remaining.  In  other  words,  the  system  may  be  meeting  all 
peacetime  demands,  but  will  have  nothing  in  reserve  to 
handle  increased  wartime  requirements. 

Personnel  capability  and  equipment  capability  are 
also  influenced  by  a  maintainability  factor  which  is  a  pro¬ 
duct  from  the  Research  and  Development  Sector.  Maintain¬ 
ability  will  be  discussed  in  the  following  section.  The 
relationships  between  aircraft  in  maintenance,  the  capa¬ 
bility  factors,  and  maintainability  are  depicted  in  Figure 


3-10. 
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Fig.  3-10.  Maintenance  Sector  Causal  Loop  Diagram 


Figure  3-10  also  summarizes  the  relationships 
within  the  Maintenance  Sector.  This  sector  depicts  a 
positive  causal  loop  indicating  that  there  is  a  tendency 
for  uncontrolled  growth.  For  example,  if  the  capabilities 
increase  to  such  an  extent  that  less  and  less  aircraft  are 
in  maintenance,  the  capabilities  will  continue  to  grow. 
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The  limiting  variable  in  this  sector,  however,  is  the 
number  of  successful  sorties.  This  variable  will  increase 
through  the  dynamic  behavior  of  the  model,  thus  increasing 
the  number  of  aircraft  in  maintenance. 

A  key  measure  in  this  sector  is  the  number  of  air¬ 
craft  in  maintenance  because  of  the  important  effects  this 
variable  has  on  other  elements  in  the  sector  and  in  the 
overall  model.  Also  important  is  the  aircraft  repair  rate 
which  ultimately  controls  the  number  of  aircraft  in  mainte¬ 
nance. 


Research  and  Development  Sector 
The  final  sector  to  be  developed  in  this  chapter  is 
the  Research  and  Development  Sector.  The  RfcD  Sector  is  an 
important  sector  because  the  output  is  engineering  produc¬ 
tivity.  This  productivity  is  in  the  form  of  inherent  reli¬ 
ability  and  the  maintainability  built  into  a  piece  of  equip¬ 
ment.  Roberts  stated  in  his  book.  The  Dynamics  of  Research 
and  Development,  "The  most  critical  production  project 
resource  is  engineering  manpower  (14:19).”  Capital  invest¬ 
ment  is  also  included  in  the  concept  of  the  number  of 
engineers  produced.  The  basic  assumption  used  in  this  sec¬ 
tor  is  that  if  RfcD  acquires  more  engineers,  composite  spend¬ 
ing  will  also  occur  in  capital  investment.  Consequently, 
the  more  experienced  engineers  that  are  used  productively, 
the  more  reliability  and  maintainability  are  produced. 
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Reliability  and  aircraft  in  maintenance  influence 
the  desired  level  of  engineers  (OLE) .  As  reliability 
increases,  the  desired  level  of  engineers  decreases,  but  as 
aircraft  in  maintenance  increase,  the  desired  level  of 
engineers  also  increases.  These  relationships  are  depicted 
in  Figure  3-11. 
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Fig.  3-11.  Reliability  and  Aircraft  in  Maintenance 
to  Desired  Level  of  Engineers  Relationship 


As  the  desired  level  of  engineers  increases,  the 
hiring  rate  of  engineers  (HR)  increases,  creating  the  posi¬ 
tive  relationship  depicted  in  Figure  3-12. 
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Fig.  3-12.  Desired  Level  of  Engineers  to  Hiring 
Rate  Relationship 


As  the  hiring  rate  increases,  new  engineers  also 
increase,  thus  providing  another  positive  relationship. 
This  relationship  is  depicted  in  Figure  3-13. 


Hiring  Rate  (HR)  _ New  Engineers  (NE) 

Fig.  3-13.  Hiring  Rate  to  New  Engineers  Relationship 
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There  is  a  delay  from  the  hiring  of  new  engineers 
until  they  become  productive,  experienced  engineers  (EE) . 
This  relationship  is  positive  and  is  shown  in  Figure  3-14. 
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Fig.  3-14.  New  Engineers  to  Experienced 
Engineers  Relationship 


Engineering  manpower  by  itself  is  not  a  particularly 
useful  concept.  Currently,  Air  Force  engineering  manpower 
is  in  critical  short  supply.  The  Air  Force  is  actively 
pursuing  engineering  graduates  in  order  to  increase  this 
manpower  level.  In  this  model,  engineering  manpower  will 
be  converted  into  a  technological  base.  It  is  the  tech¬ 
nology  available  and  how  much  of  this  technology  is 
incorporated  into  aircraft  production  that  determines  the 
actual  improvements  in  maintainability  and  reliability. 

The  number  of  experienced  engineers  has  a  positive 
relationship  with  the  technological  base  produced  by  the 
RtD  Sector.  The  increase  in  the  technological  base 
increases  both  the  inherent  reliability  and  the  maintain¬ 
ability  of  the  aircraft  equipment.  These  relationships 
are  depicted  in  Figure  3-15. 
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Fig.  3-15.  Experienced  Engineers  to  Technology  to 
Reliability  and  Maintainability  Relationship 
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The  Research  and  Development  Sector  is  summarized 


in  Figure  3-16. 


Maintenance 
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Fig.  3-16.  Research  and  Development  Sector 
Causal  Loop  Diagram 


Composite  Causal  Loop  Diagram 
The  entire  model  can  now  be  illustrated  through 
the  combined  pairwise  relationships  that  have  previously 
been  described.  This  causal  loop  diagram  will  be  the  basis 
for  the  subsequent  flow  diagrams  and  equations  that  will 
be  discussed  in  Chapter  IV.  This  composite  causal  loop 
diagram  is  depicted  in  Figure  3-17. 
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Fig.  3-17.  Composite  Causal  Loop  Diagram 
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CHAPTER  IV 


FLOW  DIAGRAMS  AND  EQUATIONS 
Introduction 

Developed  in  Chapter  III  was  the  conceptual  model 
of  the  operational  reliability  system  through  the  verbal 
descriptions  and  causal  loop  diagrams.  The  task  at  hand  in 
this  chapter  is  to  develop  a  structural  model  through  flow 
diagrams.  From  these  flow  diagrams^  DYNAMO  equations  will 
be  constructed.  These  DYNAMO  equations  will  be  used  to 
computerize  the  operational  reliability  model.  A  verbal 
description  is  included  to  provide  the  logic  behind  the 
development  of  the  flow  diagrams  and  DYNAMO  equations.  The 
structure  of  the  model  will  be  developed  by  sectors  just  as 
the  causal  loop  diagrams  were  developed  in  Chapter  III. 

The  Maintenance  Sector  will  be  developed  first.  Figure  4-1 
is  the  flow  diagram  for  the  Maintenance  Sector. 

Maintenance  Sector 

The  Maintenance  Sector  has  two  levels,  aircraft 
availability  (AA) 2  and  aircraft  in  maintenance  (AM).  This 

*The  flow  diagram  symbology  and  an  example  is  con¬ 
tained  in  Chapter  II. 

2 

The  variable  symbols  used  in  the  equations  will 
be  identified  the  first  time  the  variable  is  used  in  this 
chapter. 
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Maintenance  Sector 


sector  also  has  two  rates,  aircraft  repair  rate  (ARR)  and 
aircraft  into  maintenance  rate  (AIMR) ,  which  control  the 
flows  between  the  levels.  The  level  equations  are: 

L  AA.K-AA. J+DT* (ARR. JK-AIMR. JK) 

L  AM. K*AM. J+DT* (AIMR. JK-ARR. JK) 

As  can  be  seen  from  the  level  equations,  the  total 
number  of  aircraft  available  and  aircraft  in  maintenance 
form  a  subsystem  in  which  resources  are  conserved.  That  is, 
aircraft  are  neither  added  nor  deleted.  In  this  model, 
the  total  number  of  aircraft  available  and  aircraft  in 
maintenance  is  8600.  This  is  the  approximate  number  of 
aircraft  in  the  USAF  inventory.  Developed  in  the  next  sec¬ 
tion  will  be  the  rate  equations. 

The  aircraft  into  maintenance  rate  is  the  total  of 
all  scheduled  and  unscheduled  maintenance  performed  on  the 
aircraft.  Scheduled  maintenance  is  a  percentage  of  the 
level,  aircraft  available.  The  scheduled  maintenance  per¬ 
centage  includes  Programmed  Depot  Maintenance  (PDM) . 
Unscheduled  maintenance  is  a  percentage  of  the  sortie  com¬ 
pletion  rate  (SCR) .  The  sortie  completion  rate  will  be 
developed  later  in  the  chapter.  Unscheduled  maintenance 
is  the  maintenance  tasks  that  are  required  as  a  result  of 
flying  aircraft.  Therefore,  the  more  sorties  that  are 
flown,  the  more  unscheduled  maintenance  will  be  required. 

The  aircraft  into  maintenance  rate  equation  is: 


SI 


R  AIMR.KL-SMF.K*AA.K+UMF.K*SCR. JK 


where  SMF  is  the  scheduled  maintenance  factor  and  UMF  is 
the  unscheduled  maintenance  factor.  It  must  be  noted  that 
if  aircraft  available  drops  to  a  low  number,  then  the  num¬ 
ber  of  aircraft  going  into  scheduled  maintenance  will  also 
be  a  low  number.  This  is  a  valid  situation  for  two  reasons. 
First,  because  many  of  the  scheduled  maintenance  tasks  are 
of  a  routine  nature,  the  maintenance  tasks  can  be  post¬ 
poned  temporarily  until  more  aircraft  are  available  for 
scheduling.  This  situation  occurs  frequently  at  base  level 
when  operational  requirements  are  high.  Secondly,  if  the 
aircraft  are  not  available  for  scheduled  maintenance  it 
must  be  because  the  aircraft  are  flying  sorties.  The 
increase  in  flying  sorties  increases  the  unscheduled  main¬ 
tenance  performed.  Consequently,  many  of  the  scheduled 
maintenance  tasks  will  be  performed  concurrent  with  the 
unscheduled  maintenance  tasks. 

The  unscheduled  maintenance  factor  includes  an 
unscheduled  maintenance  constant  (UMC)  and  inherent  relia¬ 
bility  (IR).  Inherent  reliability  is  included  because  as 
more  reliability  is  designed  into  the  equipment  one  would 
expect  to  have  fewer  failures  and  consequently,  less  main¬ 
tenance  to  perform.  The  equations  are: 


A  UMF.K-UMC-IR.K 
C  UMC- . 3 
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The  formulation  of  the  aircraft  repair  rate  equa¬ 
tion  was  considerably  more  complex  than  was  the  formulation 
of  the  aircraft  into  maintenance  rate  equation.  Recall 
from  Chapter  III  that  four  factors  made  up  the  aircraft 
repair  rate.  The  factors  are  personnel  capability  (PC) , 
supply  capability  (SC),  equipment  capability  (EC),  and 
facilities  capability  (FC) .  The  total  capability  provided 
by  these  four  factors  is  the  aircraft  repair  factor  (ARP) . 
The  aircraft  repair  rate  is  the  aircraft  repair  factor 
multiplied  by  the  number  of  aircraft  in  maintenance. 

Because  performing  maintenance  requires  a  certain  amount  of 
time,  a  DYNAMO  third  order  delay  function,  DELAY3,  is  used 
to  simulate  the  actual  repair  rate.  The  equations  just 
described  are: 

R  ARR.KL-DELAY3 (AR.K.MDEL) 

C  MDEL*Average  days  aircraft  remain  in  maintenance 

A  AR.K-ARF.K*AM.K 

A  ARF. K“ (PC. K+SC . K+EC . K+FC. K) /100 

The  values  for  personnel  capability,  supply  capa¬ 
bility,  equipment  capability,  and  facilities  capability 
are  all  derived  from  DYNAMO  table  functions.  Table  func¬ 
tions  were  used  in  this  model  because  adequate  Air  Force 
measures  for  these  capabilities  do  not  exist.  The  table 
functions  provide  the  modeler  with  the  capability  to  esti¬ 
mate  what  the  relationship  between  two  variables  might  be. 
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Figures  4-2,  4-3,  4-4,  and  4-5  contain  the  graphical  repre¬ 
sentations  of  the  relationships  between  the  four  capability 
factors  and  aircraft  in  maintenance.  These  relationships 
are  in  terms  of  relative  numbers  only.  That  is,  the  num¬ 
bers  have  no  meaning  outside  this  model.  Possible  ways  to 
measure  these  numbers  in  the  actual  operational  environment 
will  be  discussed  in  Chapter  V.  The  authors  recognize  that 
the  use  of  the  table  functions  in  DYNAMO  without  empirical 
evidence  to  substantiate  the  relationships  can  create  ques¬ 
tions  about  the  external  validity  of  this  model  (2:391). 

To  preclude  a  portion  of  this  criticism,  sensitivity 
analysis  using  different  numerical  relationships  within  the 
table  functions  will  be  conducted.  The  results  of  this 
validity  check  are  discussed  in  Chapter  V. 

The  concept  embedded  in  each  of  the  four  capability 
factors  is  that  a  finite  capability  exists.  This  limited 
capability  can  only  repair  a  maximum  number  of  aircraft. 

As  more  aircraft  are  in  need  of  maintenance,  less  capa¬ 
bility  remains  to  repair  additional  aircraft.  This  means 
that  the  aircraft  repair  rate  will  increase  as  aircraft  in 
maintenance  increase  until  all  the  capability  is  consumed. 

If  more  aircraft  require  maintenance,  a  queue  of  aircraft 
awaiting  maintenance  will  develop.  In  this  situation,  there 
is  no  capability  to  draw  upon  in  the  event  of  increased 
demands.  Thus,  how  much  capability  is  remaining  could  be 
very  important  in  determining  the  amount  of  increased 


flying  that  can  be  accomplished.  For  example,  a  wing  or 
squadron  may  be  meeting  its  peacetime  flying  commitments, 
but  may  require  90  percent  to  100  percent  of  its  mainte¬ 
nance  capability  to  accomplish  it. 

Two  of  the  capability  factors,  personnel  and  equip¬ 
ment,  have  additional  variables  that  influence  the  values 
obtained  from  the  tables.  Personnel  capability  is  influ¬ 
enced  by  the  personnel  repair  rate  multiplier  (PRRM) .  This 
multiplier  is  obtained  from  another  table  function.  This 
multiplier  is  based  on  the  fact  that  improvements  in  tech¬ 
nology  will  result  in  improvements  in  maintainability. 

These  improvements  in  maintainability  allow  a  maintenance 
technician  to  perform  more  maintenance  tasks  than  could 
previously  have  been  accomplished.  This  means  that  the 
personnel  capability  has  been  increased.  The  equations 
and  table  functions  for  personnel  capability  are: 

A  PC. K-TABHL (PCT, AM. K,0, 8600, 1075) *PRRM. K 
T  PCT-40/38/36/34/32/30/28/25/23 
A  PRRM. K "TAB HL (PRRMT, PPA. K0, . 5 , . 1) 

T  PRRMT" .8/. 88/. 96/1. 04/1. 12/1. 2 

A  PPA.  K-(PERCP.K/ MAIN.  K)  MPERS/TAC) 

A  PERCP . K-TABHL ( PERCPT , MAIN . K, 0 . 1, . 2) 

T  PERCPT-0/.001/.004/.009/.016/.025 
A  MAIN. K-TABHL (MAINT, TECH. K,0,l,.l) 

T  MAINT- . 001/. 02/. 03/. 04/. 06/ .08/.!/. 15/ .2/ .4/1 
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C  PERS-Total  number  maintenance  personnel  in  USAF 
C  TAC-Total  number  aircraft  in  USAF  inventory 


Figures  4-6,  4-7,  and  4-8  contain  the  graphs  of  the  table 
functions  for  personnel  repair  rate  multiplier,  personnel 
capacity  (PERCP)  and  maintainability  (MAIN),  respectively. 

Equipment  capability  is  also  enhanced  through  tech¬ 
nological  improvements.  This  enhancement  is  accomplished  in 
the  model  through  the  equipment  repair  rate  multiplier 
(ERRM) .  The  value  of  the  equipment  repair  rate  multiplier 
is  determined  through  a  table  function  by  the  value  of  tech¬ 
nology.  Figure  4-9  shows  this  relationship  in  graphical 
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Fig.  4-6.  Personnel  Repair  Rate  Multiplier 
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Fig.  4-7.  Personnel  Capacity 
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Fig.  4-8.  Maintainability 
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Pig.  4-9.  Equipment  Repair  Rate  Multiplier 


The  equations  for  equipment  capability  are 


A  EC. K»TABHL(ECT, AM. K, 0,8600, 1075) 


T  ECT»15/14/ 13/ 12 . 5/12/11/10.5/10/9 


A  ERRM.K«TABHL(ERRMT, TECH. K, 0,1, .1) 


T  ERRXr-1/1. 05/1. 1/1. 15/ 1.2/1. 25/ 1.3/1. 35/1.4/1.45/1. 5 


Supply  capability  and  equipment  capability  do  not  have  any 
multipliers  and  the  equations  are: 


A  SC. K-TABHL(SCT, AM. K, 0,8600, 1075) 


A  PC. K-TABHL(PCT,AM.K, 0,8600, 1075) 


T  FCT-15/ 14/ 13/12. 5/12/11/10. 5/10/9 
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This  completes  the  development  of  the  Maintenance  Sector. 

The  Operations  Sector  will  be  developed  next. 

Operations  Sector 

The  Operations  Sector  of  this  model  determines 
how  many  aircraft  sorties  will  be  scheduled  and  ultimately 
flown.  There  are  three  potentially  limiting  factor c: 

(1)  the  number  of  flying  hours  available,  (2)  the  number 
of  crews  available,  and  (3)  the  number  of  available  air¬ 
craft.  Figure  4-10  contains  the  flow  diagram  depicting  the 
relationships  among  these  variables. 

An  assumption  used  in  the  model  is  that  each  sortie 
scheduled  requires  one  crew,  and  there  was  no  delay  involved 
in  turning  crews  around  to  make  them  available  to  fly  more 
sorties.  This  assumption  is  reasonable  in  that  it  is 
unlikely  that  all  crews  will  be  used  at  the  same  time.  If 
this  condition  were  to  occur,  then  those  crews  would  require 
crew  rest  before  becoming  available  to  fly  more  sorties. 

The  delay  caused  by  the  crew  rest  period,  however,  is  suf¬ 
ficiently  short  to  become  lost  in  the  noise  level  of  the 
system. 

The  first  equation  developed  in  this  sector 
incorporates  flying  hours  available  (FHA)  into  the  model. 

The  equation  is: 


L  FHA. JaFHU. J+PULSE  (PH ,  364 , 364 )  -f PULSE  (PHI ,  273,  364 ) 


The  pulse  functions  input  flying  hours  yearly  with  every 
fourth  quarter  having  an  input  higher  than  the  other  three 
quarters.  This  allocation  of  flying  hours  is  consistent 
with  how  the  Air  Force  allocates  flying  hours  to  the 
operating  commands.  The  fourth  quarter  allocation  is  larger 
because  there  has  been  a  historical  trend  to  fly  more  in 

t 

the  summer  (13:144).  FHU  is  flying  hours  used  and  repre¬ 
sents  the  flying  hours  consumed  by  the  aircraft  sorties 
flown.  The  equation  for  flying  hours  used  is: 

A  FHU.K-SCR. JK*SL 

where  SCR  is  the  sortie  completion  rate  and  SL  is  the 
average  sortie  length.  A  sortie  length  of  3.5  hours  was 
used  in  this  model.  This  is  the  average  sortie  length  of 
bomber,  cargo,  and  fighter  aircraft. 

The  number  of  crews  available  (CA)  is  the  second 
variable  which  could  potentially  limit  the  number  of  sorties 
that  might  be  flown.  The  equation  for  crews  available  is: 

L  CA.K-CA. J+DT* (CTR.JK-CAR.JK) 

where  CTR  is  the  crew  training  rate  (not  crew  proficiency 
training)  and  CAR  is  the  crew  attrition  rate.  The  level 
of  crews  available  to  fly  sorties  is  determined  by  the  dif¬ 
ference  between  the  number  of  trained  crews  and  the  number 
of  crews  no  longer  available  because  of  retirement  or 
reassignment. 


The  crew  training  rate  depends  on  the  number  of 
crews  available  initially  (CAI)  and  a  sinusoidal  input 
function.  Crews  available  initially  was  determined  by 
using  an  average  crew  ratio  of  2.0  multiplied  by  the  approxi¬ 
mate  number  of  aircraft  in  the  inventory  (8600)  (13:144). 

The  sinusoid  input  simulates  a  ten-year  cycle  between  the 
high  and  low  points  of  crew  availability.  The  Air  Force 
appears  to  go  through  a  period  of  too  many  pilots  and  navi¬ 
gators  which  induces  top  level  management  to  make  cutbacks 
in  the  training  of  new  crews.  Approximately  five  years 
later  there  are  too  few  pilots  and  navigators,  and  the 
policy  decision  is  made  to  train  more  crews.  The  crew 
training  rate  equation  is: 

R  CTR.KL- (CAI+ (1. 0*SIN (6 . 283*TIME .K/CPER) ) ) /DT 

The  crew  attrition  rate  is  determined  by  the  average 
time  a  crew,  once  trained,  remains  on  flying  status.  The 
crew  attrition  rate  equation  is: 

R  CAR. KL“CA. K/CDEL 

C  CDEL-Average  time  on  flying  status 

The  third  potential  factor  which  could  limit  the 
number  of  sorties  flown  was  aircraft  availability.  The 
equation  for  aircraft  availability  was  developed  in  the 
Maintenance  Sector. 
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Having  explained  the  factors  which  determine  the 
number  of  sorties  that  can  be  flown,  the  equation  for 
scheduled  sorties  (SS)  can  be  constructed.  The  equation  is: 

L  SS.K-SS.  J+DT*  (SSR.  JK)  -f PULSE  ( -SS . J,  364,364) 

This  equation  collects  scheduled  sorties  for  each  year. 
Scheduled  sorties  increase  by  the  scheduled  sortie  rate 
(SSR) .  The  pulse  function  empties  the  level  yearly.  The 
depletion  of  the  level  is  done  to  keep  scheduled  sorties 
from  growing  to  an  unrealistic  number. 

A  set  of  decision  rules  was  developed  to  determine 
the  scheduled  sortie  rate.  The  initial  step  was  to  deter¬ 
mine  a  daily  rate  of  flying  sorties  that  would  use  up  the 
flying  hours  available.  This  was  accomplished  by  use  of 
the  following  equation. 

A  NSA.K-( (FHA.K/SL) / ( 36  5-YTIM. K) ) *DT 

where  NSA  is  the  number  of  sorties  available  and  YTIM  is  a 
timing  function  to  count  the  number  of  days  in  a  year.  A 
DYNAMO  clip  function  was  used  to  select  the  smaller  of  the 
two  numbers,  sorties  available  or  aircraft  available.  The 
smaller  number  becomes  the  limit  between  sorties/aircraft 
(LBSA) .  The  equation  is: 

A  LBSA. K-CLIP (NSA. K,AA.K,AA.K, NSA. K) 
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The  value  stored  in  limit  between  sorties/aircraf t  is  com¬ 
pared  with  crews  available,  and  the  smaller  number  is 
stored  in  available  scheduled  aircraft  (ASA) .  The  equation 
is: 

A  ASA . K*CLI P ( LBS A . K , CA . K , CA . K , LBSA . K ) 

Available  scheduled  aircraft  becomes  the  scheduled  sortie 
rate  in  the  equation: 

R  SSR.K.-ASA.K 

After  scheduling  the  sorties,  the  number  of  success¬ 
ful  sorties  (SUCS)  can  be  determined.  The  equation  for  suc¬ 
cessful  sorties  is: 

L  SUCS. K-SUCS. J+DT* (SCR. JK) +PULSE (-SUCS. J, 364 , 364) 

The  sortie  completion  rate  (SCR)  determines  the  level  of 
successful  sorties.  The  pulse  function  is  used  in  the 
same  manner  as  it  was  in  the  level  equation  for  scheduled 
sorties.  The  sortie  completion  rate  is  a  function  of  the 
scheduled  sortie  rate  and  a  sortie  completion  rate  factor 
(SCRF) .  The  sortie  completion  rate  factor  is  a  function  of 
sortie  aborts  (SA)  and  an  inherent  reliability  multiplier 
(IRM).  The  sortie  abort  rate  is  a  percentage  obtained 
from  KO  51  System  Effectiveness  Reports.  Sortie  aborts 
is  input  to  a  random  number  generator  which  provides  the 
normal  random  deviates  used  in  the  model.  The  inherent 


reliability  multiplier  recognizes  that  as  more  inherent 
reliability  is  designed  into  the  aircraft,  the  number  of 
sortie  aborts  will  decrease.  The  set  of  equations  just 
described  is: 

R  SCR.KL-SSR. JK*SCRF.K 
A  SCRF.K-l-NORMRN(SA.SD) *IRM.K 
C  SA-.04 
C  SD-.02 
A  IRM.K-l-IR.K 

This  completes  the  equation  set  for  the  Operations  Sector. 
The  third  and  final  sector  of  this  model.  Research  and 
Development,  will  be  covered  next. 

Research  and  Development  Sector 
Discussion  of  the  Research  and  Development  Sector 
will  complete  the  presentation  of  the  Operational  Reliabil¬ 
ity  Model.  The  flow  diagram  for  this  sector  is  contained 
in  Figure  4-11.  The  first  level  equation  in  this  sector 
provides  the  number  of  new  engineers  (E) .  The  equation  for 
this  level  is: 

L  NE.K-NE. J*DT*(HR. JK-EER.JK) 


The  number  of  new  engineers  is  controlled  by  the  hiring 
rate  (HR)  and  the  experienced  engineer  rate  (EER) . 


Pig.  4-11.  Research  and  Development  Sector 


The  hiring  rate  is  determined  by  the  hiring  rate 
factor  (HRF) .  The  hiring  rate  factor  is  the  difference 
between  a  desired  level  of  engineers  (DLE)  and  the  level  of 
new  engineers  divided  by  a  hiring  rate  delay  (HRD) .  This 
delay  represents  the  amount  of  time  it  takes  to  begin 
hiring  new  engineers  after  the  policy  decision  has  been 
made  to  hire.  The  experienced  engineer  rate  is  the  level 
of  new  engineers  divided  by  the  time  required  for  new 
engineers  to  gain  experience.  The  equation  set  is: 

R  HR.KL-HRF.K 
A  HRF. K* (DLE. K-NE. K) /HRD 
C  HRD-728 
R  EER.KL-NE.K/EDEL 
C  EDEL-728 

The  desired  level  of  engineers  is  determined  by  a 
table  function  using  the  number  of  aircraft  in  maintenance 
as  the  independent  variable.  Figure  4-12  provides  a  graph 
of  the  relationship  between  the  desired  level  of  engineers 
and  the  number  of  aircraft  in  maintenance.  The  value 
obtained  from  the  table  is  modified  by  the  inherent  relia¬ 
bility  multiplier.  This  is  because  as  inherent  reliability 
in  equipment  increases,  the  desire  for  more  engineers 
decreases. 

As  explained  in  Chapter  III,  the  need  for  engineers 
increases  as  the  number  of  aircraft  in  maintenance  increase. 


Fig.  4-12.  Desired  Level  of  Engineers 

A  DYNAMO  smooth  function  is  used  as  the  input  argument  to 
the  table  function.  The  smooth  function  filters  out  any 
short-term  fluctuations  in  aircraft  in  maintenance.  The 
equations  just  described  are: 

A  SAM. K“SMOOTH (AM. K , 364 ) 

A  DLE. K-TABHL(DLET, SAM. K, 0,8600, 1075) *IRM.K 

T  DLET-0/650/760/830/ 950/1000/1000/1000 

As  explained  previously,  the  new  engineers  become 
experienced  engineers  (EE)  through  training  and  knowledge 
gained  from  the  job.  At  the  same  time,  experienced 
engineers  retire  or  leave  to  take  other  jobs.  The  experi¬ 
enced  engineering  rate  has  already  been  developed.  The 
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engineering  attrition  rate  (EAR)  is  the  level  of  experienced 
engineers  divided  by  the  average  time  an  engineer  remains 
working.  The  equations  are: 

L  EE.K-EE. J+DT* (EER. JK-EAR. JK) 

R  EAR. KL-EE.K/ ADEL 

C  ADEL- 36 40 

The  two  outputs  from  the  Research  and  Development 
Sector  are  inherent  reliability  (IR)  and  technology  (TECH) . 
Both  of  these  variables  have  values  determined  by  table 
functions  which  use  experienced  engineers  as  the  input 
argument.  Figures  4-13  and  4-14  contain  graphs  of  the 
relationships . 

The  equations  for  inherent  reliability  and  tech¬ 
nology  are: 

A  IR. K-TABHL(IRT, TECH. K, 0,1.0, .25) 

T  I RT- . 01/. 015/. 04/. 1/. 2 

A  TECH.K-TABHL(TECHT,EE.K, 0,1000, 100) 

T  TECHT-0/ .07/. 2/. 35/. 45/. 5/. 55/. 65/. 8/. 93/1 

The  table  functions  in  this  sector  depict  relative  rela¬ 
tionships  only.  As  was  stated  earlier,  these  variables 
described  by  table  functions  point  out  the  need  for  quanti¬ 
tative  measurement  to  determine  their  actual  importance  in 
influencing  system  behavior. 


Fig.  4-13.  Inherent  Reliability 
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Fig.  4-14.  Technology 
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This  completes  the  development  of  the  equation  set 
for  the  Research  and  Development  Sector.  It  also  signals 
the  completion  of  the  structural  model  and  the  equations 
necessary  to  computerize  the  model.  A  flow  diagram  of  the 
entire  model  is  in  Figure  4-15.  A  listing  of  all  the  equa¬ 
tions  in  the  basic  model  can  be  found  in  Appendix  A. 

Chapter  V  will  describe  the  basic  runs  made  with 
the  model.  Sensitivity  analysis  will  be  conducted  to  deter 
mine  variables  that  are  important  to  model  behavior. 

Chapter  V  will  end  with  conclusions  and  recommendations 
that  are  generated  by  conducting  the  simulation  experiments 


HUM 


CHAPTER  V 


MODEL  VALIDATION,  SENSITIVITY  ANALYSIS, 

AND  CONCLUSIONS 

Introduction 

Discussed  in  Chapter  V  will  be  the  validation  and 
sensitivity  analysis  of  the  Operational  Reliability  Model. 
Conclusions  and  recommendations  for  continuing  research 
will  complete  the  chapter. 

The  Operational  Reliability  Model,  developed 
through  the  system  dynamics  paradigm,  is  a  representation  of 
the  complex  reliability  system.  The  model  was  used  to 
evaluate  current  policy  as  well  as  policy  changes  that  may 
improve  the  reliability  system.  The  model  demonstrated 
the  potential  effects  that  these  policy  changes  may  have 
on  the  operational  reliability  of  aircraft  weapon  systems. 

Initial  Simulation  Run 

The  initial  simulation  run  was  used  for  two  pur¬ 
poses.  First,  an  initial  run  was  made  to  ascertain  if  the 
model  reproduced  actual  system  behavior.  The  results  are 
covered  in  more  detail  in  the  section  on  model  validation. 
Secondly,  the  results  from  the  first  simulation  run  were 
used  as  the  basis  for  comparison  with  the  other  simulation 
runs  which  incorporate  policy  changes.  The  plot  of  this 
first  run  is  contained  in  Appendix  C. 


75 


The  time  period  for  the  initial  simulation  run  and 
each  subsequent  run  was  five  years.  The  five-year  period 
was  chosen  as  the  time  in  which  policy  changes  make  their 
effects  apparent  in  system  behavior.  Six  variables  were 
chosen  as  measures  of  system  performance.  The  variables 
are  aircraft  availability,  aircraft  in  maintenance,  aircraft 
repair  rate,  sortie  completion  rate,  repair  capability,  and 
aircraft  maintenance  capability. 

The  research  indicated  that  the  sortie  completion 
rate  was  the  best,  single  measure  of  operational  reliabil¬ 
ity.  As  shown  in  the  results,  the  sortie  completion  rate 
was  fairly  constant  relative  to  the  flying  hours  available. 
The  number  of  aircraft  in  maintenance  also  provides  valuable 
information  about  the  operational  reliability  of  the  system. 
Too  many  aircraft  in  maintenance  indicated  that  there  were 
too  few  aircraft  available  to  fly  sorties.  This  fact  would 
cause  the  sortie  completion  rate  to  decrease.  The  aircraft 
repair  rate  was  the  key  factor  in  determining  the  through¬ 
put  of  aircraft  in  maintenance.  The  aircraft  repair  rate 
must  be  sufficient  to  make  aircraft  available  to  fly 
sorties.  The  aircraft  repair  rate  is  dependent  on  the 
maintenance  capability  of  the  Air  Force.  This  maintenance 
capability  is  in  large  part  a  determinant  of  the  total 
capability  of  the  Air  Force  to  perform  assigned  missions. 

It  appears  then,  that  a  finding  of  this  research  supports 
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the  conclusion  that  operational  reliability  is  a  function 
of  the  total  Air  Force  capability. 

Operational  Reliability  =  f (Total  Air  Force  Capability) 

Thus,  a  critical  problem  identified  by  this  research  was  to 
measure  the  total  Air  Force  capability.  An  attempt  to 
determine  a  measure  of  this  capability  was  considered  next. 

Repair  capability  and  aircraft  maintenance  capa- 
bility  were  computed  by  supplementary  equations  only  to  pro¬ 
vide  output  measures.  Appendix  B  contains  the  formulation 
of  these  two  equations.  Repair  capability  and  aircraft 
maintenance  capability  measure  the  capability  remaining  to 
repair  additional  aircraft  as  well  as  those  already  in 
repair.  Repair  capability  was  in  the  units,  percentage 
aircraft  per  day.  Aircraft  maintenance  capability  was  mea¬ 
sured  in  units  of  aircraft  per  day. 

These  measures  are  consistent  with  the  definitions 
of  personnel,  supply,  equipment,  and  facilities  capabili¬ 
ties.  These  definitions  stated  that  there  was  only  a 
finite  limit  to  the  total  maintenance  capability.  Each  air¬ 
craft  in  maintenance  consumed  a  portion  of  the  total  capa¬ 
bility  was  measured  by  repair  capability  and  aircraft 
maintenance  capability. 

Measurements  such  as  repair  capability  and  aircraft 
maintenance  capability  appear  to  be  important  to  determine 
surge  capability  to  meet  unforeseen  contingency  actions. 
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Currently  used  measures  of  system  performance  such  as  Not 
Mission  Capable  Supply  (NMCS),1  measure  only  the  areas  which 
are  experiencing  difficulties.  On  an  Air  Force-wide  basis, 
measurement  of  the  total  capability  available  has  been 
difficult  to  determine.  Military  exercises  are  conducted 
periodically  in  an  attempt  to  exercise  and  determine  what 
this  capability  may  be.  These  exercises  are  costly,  of 
short  duration,  and  normally  well  planned.  Therefore,  they 
may  not  be  indicative  of  a  long-term,  substantial  level  of 
operations.  A  suggestion  on  how  to  measure  this  capability 
is  provided  in  the  conclusions  section. 

The  output  from  each  simulation  run  was  contained 
in  two  plots.  One  plot  contained  the  output  for  the 
flying  hours  available,  aircraft  available,  aircraft  in 
maintenance,  and  aircraft  repair  rate.  The  other  plot 
contained  the  output  for  sortie  completion  rate,  repair 
capability,  and  aircraft  maintenance  capability.  Each  plot 
provided  a  time  scale  in  days  along  the  vertical  axis  with 
one  block  representing  one  year.  The  horizontal  axis  pro¬ 
vided  the  scale  for  each  variable.  A  legend  was  included 
with  each  plot  matching  the  variable  symbol  with  the  symbol 
used  on  the  plot. 

^NMCS  is  a  new  term  which  is  the  rough  equivalent 
of  the  older  more  familiar  term  Not  Operationally  Ready 
Supply  (NORS) . 
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The  plots  from  the  initial  simulation  run  showed 
the  model  variables  in  equilibrium  for  the  first  three 
years.  Flying  hours  available  were  being  consumed  on  a 
yearly  basis,  and  the  sortie  completion  rate  was  relatively 
constant.  The  increase  in  the  sortie  completion  rate  near 
the  end  of  each  year  corresponded  to  the  increase  in 
allocated  flying  hours  for  the  fourth  quarter  of  each  year. 
At  the  three-year  point,  increased  technology  from  the 
Research  and  Development  Sector  began  to  exert  an  effect 
on  model  behavior.  The  variable  changes  were  all  within  a 
3-7  percent  range  except  for  the  aircraft  maintenance  capa¬ 
bility  which  changed  approximately  20  percent.  The  next 
section  discusses  how  well  these  results  compare  with 
actual  system  behavior. 

Model  Verification/Validation 

Model  verification  consisted  of  determining  that 
the  model  equations  did,  in  fact,  correspond  to  the  system 
structure  that  was  developed  by  the  flow  diagrams  in 
Chapter  IV.  Because  the  equations  were  developed  concur¬ 
rent  with  the  flow  diagrams,  verification  of  the  model  has 
already  been  accomplished. 

Validation  of  the  model  was  determined  by  comparing 
the  results  from  the  initial  run  with  the  actual  behavior 
of  the  system  under  study.  The  initial  simulation  results 
indicated  a  stable  system  with  a  constant  sortie  completion 
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rate  (peaking  in  the  summer)  and  constant  values  for  air** 
craft  availability  and  aircraft  in  maintenance.  These 
results  could  not  be  compared  directly  with  the  actual 
operational  system  because  of  the  approximately  ten-year 
decline  in  flying  hours  available  as  well  as  the  number 
of  aircraft  in  the  Air  Force  inventory.  Available  measures 
such  as  NMCS  and  Not  Mission  Capable  Maintenance  (NMCM)  have 
remained  fairly  constant  in  that  same  time  period. 

Although  the  simulation  results  did  not  reproduce  the  same 
numbers  portrayed  by  the  actual  system,  the  simulation 
results  reproduced  stable  behavior.  This  stable  behavior 
was  consistent  with  actual  system  behavior.  The  authors 
considered  this  stable  behavior  along  with  the  research 
conducted  in  determining  the  system  structure  to  be  ade¬ 
quate  validation  of  the  model.  Validation  does  not  mean 
the  model  was  100  percent  correct.  Validation  was  not  a 
process  that  ended  with  the  first  computer  run.  Additional 
research,  analysis,  and  measurement  followed  by  new  itera¬ 
tions  of  the  model  that  would  provide  a  better,  more  accu¬ 
rate  representation  of  the  system  structure. 

Sensitivity  Analysis 

As  already  stated,  two  different  policies  were 
tested  using  the  Operational  Reliability  Model.  The  first 
policy  was  a  25  percent  increase  in  personnel  capability 
through  improved  training  (3:30).  Because  more  resources 
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were  being  expended  on  training,  a  10  percent  decrease  in 
supply  capability  and  equipment  capability  was  projected 
at  the  same  time.  Appendix  0  contained  the  plots  of  the 
simulation  run  that  incorporated  this  new  policy.  Table  5-1 
is  a  table  showing  the  percentage  change  in  the  measured 
variables  between  the  old  and  new  policies. 

As  displayed  in  Table  5-1,  the  new  policy  resulted 
in  only  a  slight  change  in  aircraft  availability  and  air¬ 
craft  in  maintenance,  and  aircraft  repair  rate.  A  signifi¬ 
cant  difference  occurred  in  the  two  capability  measurements. 
Repair  capability  and  aircraft  maintenance  capability 
decreased  by  65.1  percent  and  2.26  percent  respectively. 

The  aircraft  sortie  rate  remained  the  same.  This  seemed  to 
indicate  that  the  policy  change  had  no  effect  on  the  Air 
Force's  existing  capability  to  fly  sorties  but  does  have 
a  significant  effect  of  the  surge  capability  of  the  Air 
Force.  Thus,  the  real  significance  of  this  policy  change 
was  that  the  Air  Force  would  continue  operating  as  usual. 

If  increased  operations  were  required  as  a  result  of  a  con¬ 
tingency,  the  Air  Force  would  have  less  surge  capability. 

Changing  from  three  levels  of  maintenance  to  two 
levels  of  maintenance  was  the  second  policy  tested  in  the 
Operational  Reliability  Model.  In  the  Air  Force,  the  three 
levels  of  maintenance  are  flight  line,  intermediate,  and 
depot.  The  change  to  two  levels  would  entail  eliminating 
the  intermediate  level  of  maintenance  at  all  bases  and 
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•The  first  entry  for  each  variable  is  the  average  value  for  the  first  three 
years  of  the  simulation  run.  The  second  entry  is  the  last  value  for  the  variable 
obtained  after  five  years. 


providing  consolidated  intermediate-depot  maintenance  at  a 
number  of  locations.  The  locations  depend  on  the  using 
command,  the  number  of  bases  with  a  particular  aircraft, 
and  the  location  of  these  bases.  Eliminating  the  inter¬ 
mediate  level  of  maintenance  will  result  in  a  considerable 
savings  in  personnel.  Jones  stated  that  going  from  three  to 
two  levels  of  maintenance  will  also  result  in  a  savings  of 
spare  parts  (10:30-32). 

To  simulate  this  policy  change,  the  number  of  per¬ 
sonnel  in  the  model  was  decreased  by  40  percent.  A  10  per¬ 
cent  and  25  percent  reduction  in  supply  capability  was 
tested.  A  required  criterion  for  a  two  level  maintenance 
operation  is  increased  inherent  reliability  in  the  aircraft. 
To  simulate  this  increase  in  inherent  reliability,  the 
desired  level  of  engineers  in  the  Air  Force  was  increased 
approximately  30  percent.  The  plot  of  these  simulation 
runs  are  contained  in  Appendix  E.  The  percentage  differ¬ 
ence  between  the  old  and  new  policies  is  contained  in 
Table  5-2. 

Again  the  results  showed  that  the  new  policies 
cause  only  a  slight  change  in  aircraft  in  maintenance,  air¬ 
craft  availability,  and  the  aircraft  repair  rate.  The 
sortie  completion  rate  remained  the  same.  The  significant 
change  occurred  in  capability  factors.  Switching  from 
three  levels  of  maintenance  to  two  levels  with  a  10  percent 
decrease  in  supply  capability  provided  a  2.33  percent 


increase  in  the  repair  capability  and  a  13.21  percent 
decrease  in  aircraft  maintenance  capability.  This  differ¬ 
ent  maintenance  policy  with  a  25  percent  decrease  in  supply 
capability  had  no  change  on  repair  capability  and  a  24.5 
percent  decrease  in  aircraft  maintenance  capability. 

These  results  indicated  that  switching  from  three 
levels  to  two  levels  of  maintenance  did  not  have  any  effect 
on  the  current  sortie  completion  rate.  This  policy  change 
would  probably  not  have  any  immediate  effect  on  the  opera¬ 
tional  reliability  of  the  system.  The  less  obvious  effect 
was  that  the  capability  of  the  Air  Force  would  be  decreased. 

Conclusions 

Policy  Modeling  Conclusions 

A  system  dynamics  model  of  operational  reliability 
was  constructed  and  used  to  experiment  with  policy  changes. 
These  system  experiments  indicated  that  the  system  under 
study  tended  to  exhibit  stable  behavior.  Two  performance 
measures,  repair  capability  and  aircraft  maintenance  capa¬ 
bility,  attenpted  to  provide  a  method  to  determine  the 
available  capability  of  the  Air  Force.  Both  of  these  mea¬ 
sures  changed  slightly  when  the  policy  changes  were  tested 
in  the  model .  The  data  to  determine  these  measures  of 
capability  are  not  currently  available  in  the  Air  Force. 

A  method  to  determine  these  measures  was  derived  from  the 
research  conducted  in  preparing  this  thesis. 
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In  determining  the  model  structure,  a  review  of  the 
literature  concerning  reliability  and  the  discussions  with 
individuals  knowledgable  in  the  system  were  conducted.  It 


appeared  that  many  managers  had  an  intuitive  feeling  of 
the  Air  Force's  capability.  The  amount  of  detail  contained 
within  that  intuitive  feeling  is  probably  proportional  to 
the  management  level  in  the  system  where  the  manager 
operated.  The  top  level  policy  maker  might  have  a  good 
intuitive  grasp  of  the  total  Air  Force  capability,  but  have 
a  poor  understanding  of  a  single  squadron's  capability. 

The  opposite  would  probably  be  true  of  the  manager  in 
charge  of  a  base-level  maintenance  squadron  for  a  particu¬ 
lar  aircraft. 

This  intuitive  feeling  of  capability  possessed  by 
these  managers  must  be  examined,  and  a  quantitative  measure 
must  be  developed.  To  begin  to  measure  and  define  the 
capability  of  the  Air  Force  requires  a  concerted  effort  to 
capture  the  knowledge  possessed  by  the  personnel  at  the 
workinq  level  of  the  system  which  provides  them  with  this 
intuitive  feeling.  Merely  asking  these  people  how  they 
determine  their  own  capability  would  not  be  sufficient.  A 
long-term  research  effort  conducted  by  a  multi-disciplinary 
group  would  probably  be  required.  This  group  would  have  to 
investigate  and  determine  those  system  parameters  and  their 
relationships  that  the  working  level  managers  use  to 
determine  their  capability.  This  would  be  the  starting 
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point  from  which  measures  for  Air  Force  total  capability 
could  be  determined. 

Operational  Reliability 
Model  Summary 

The  main  objective  of  this  research  was  to  develop 
a  computer  simulation  model  of  the  reliability  of  aircraft 
weapon  systems.  This  objective  was  met.  The  specific 
objectives  of  this  research  were  also  fulfilled.  The 
causal  loop  diagrams  developed  in  Chapter  III,  identified 
the  most  important  internal  and  external  forces  affecting 
the  reliability  system.  These  causal  loops  also  identified 
the  significant  cause  effect  relationships  and  information 
feedback  loops  connecting  the  internal  and  external  forces. 

A  structural  model  and  mathematical  equations  for  a  computer 
simulation  were  constructed  in  Chapter  IV.  This  Operational 
Reliability  Model  represented  the  forces,  information  flows, 
and  decision  policies  of  the  reliability  system. 

Examples  of  different  management  policies  and  how 
these  policies  affect  reliability  were  identified  in  this 
chapter.  The  model  exhibited  relative  stability  when  the 
policy  changes  were  tested.  This  stable  behavior  of  the 
reliability  model  was  similar  to  the  behavior  of  the  system 
being  tested.  In  this  chapter,  capability  was  demonstrated 
to  be  closely  related  to  reliability.  At  that  time  it  was 
pointed  out  that  the  Air  Force  currently  does  not  have  well 
defined  measures  of  the  total  capability  of  aircraft  weapon 


systems.  Air  Force  capability  was  identified  as  an  area 
requiring  additional  research.  After  measures  for  the  Air 
Force's  capability  have  been  developed,  new  data  collec¬ 
tion  systems  will  be  required  to  capture  this  information. 
The  last  objective  was  to  provide  an  improved  conceptuali¬ 
zation  of  reliability  for  other  researchers  to  build  upon. 
It  is  hoped  that  this  objective  was  fulfilled  along  with 
the  other  objectives. 

Satisfying  the  research  objectives  provided  the 
answers  to  the  research  questions.  Chapters  III  and  IV 
identified  the  relationships  between  reliability  and  other 
components  of  the  system  which  affected  the  reliability  of 
an  aircraft  weapon  system.  A  conceptual  model  of  reliabil¬ 
ity  was  developed  and  used  as  the  basis  for  the  mathe¬ 
matical  computer  simulation  model.  Finally,  the  use  of  the 
model  as  a  tool  for  policy  makers  was  demonstrated  in 
Chapter  V. 

The  authors  feel  a  final  word  on  system  dymamics  is 
needed.  The  technique  used  in  system  dynamics  modeling  was 
deceptively  simple.  The  actual  use  of  the  system  dynamics 
paradigm  from  conceptualization  through  computerization  of 
the  model  was  mentally  demanding.  It  forced  a  continual 
re-evaluation  of  the  actual  structure  of  the  system  being 
modeled.  The  question,  "Is  a  particular  variable  relevant 
to  system  behavior?”,  was  always  in  the  forefront  of  the 
model  design  effort. 


The  total  research  effort  to  prepare  this  thesis 
has  beei.  rewarding.  A  concept  of  operational  reliability 
being  closely  related  to  total  capability  of  the  Air  Force 
was  developed.  A  computer  simulation  model  was  designed 
around  this  concept  of  operational  reliability.  Construct¬ 
ing  the  model  and  using  it  to  explore  policy  changes  pro¬ 
vided  insights  into  the  reliability  system.  It  is  hoped 
that  this  thesis  assists  others  in  developing  similar 
insights  and  leads  to  a  better  understanding  of  reliability. 


89 


IMI*  OKMTUML  KL1MIL1TT  MKL 
IMMIC 

IIM  MIITCMKI  KCTM 

IMMIK 

I  MU  J*IT*  (Ml.  JMUM.  JR) 

IMI  MHMI 
IAMC  Ml'ttU 

tare  m  -  aimomft  MMiutfiLirr  (mkmfti 
IM  Ml  •  MKMn  KNII  Mil  <MKMFT/MTI 

ItW  MM  •  MKMFT  lire  MIMMKI  Mfk  (MKMFT/Mfl 

ItflMTC 

lUK  M.K>M.>IT«(MM.JR*MI.JR) 

IISM  MHMI 

mac  Mi-aaa 

lire  m  •  aiactin  re  miitomkc  imknfti 

tire  mm  •  amain  lire  mutcmkc  mtc  <aiKMn/Mn 

IIM  Ml  -  MKMn  KNII  MTC  (MKMFT/IM) 

HUMIC 

IIM  MM.K>«.K«Mr  HU. MflCI.  J( 

IIM  UKJHNMI.R 

treat  unc-.s 
mac  sk-.« 

ina  mm  -  atacun  lire  miitcmke  mtc  taiarem/MTi 
izre  m  -  MKMn  MMLNiim  taiKMnt 

UK  UK  *  MatKMCT  MIITCMKI  FRCTM  (MKMH/SMTIEl 

iaa  SK  -  SCKMLEI  MIITOMKC  FACTO!  (KKQn/MICMFTI 

iua  tea  *  mtie  caMiTiiM  lire  (mtic/md 

IZ7IMTE 

ireii  IM.IL«KLM3(M.RiMO.) 
treat  M.R*MF.I«M.I 
taaa*  <KjfiPc.i*ac.R«a.R«Fc.i)/iaa 
mac  ma-it 

lire  MR  •  MKMn  KNII  MTC  (MKNn/MTI 

ISM  M  •  MKMn  KNII  (MKMn/MT> 

ISM  MF  *  MKMn  KNII  FKTM  (KKOT/MKMnt 

isre  M  •  MKMn  II  MIITOMKC  (MKMFTI 

ISM  K  -  IffllKl  CMMILITT  (KKOn/MKMFT) 

1371  K  •  SMflT  CMMIUTT  (KKOT/MKHni 

isaa  a  •  cmikcit  cmmilitt  ikkot/mkikt) 

lire  Ft  -  FKIIITT  CMMILITT  (KKCRT/MKIKTI 

IMI  MCL  •  MIITOMKC  KLM  (MTSt 

I0MHTK 

lirei  K.R*TMKIKT»M.R.a.Maa.ia7V*FMI.R 
usar  KTMammm/st/sa/a/s/n 
IMM  MM.R»TMK  (WMT  »FN.R»#»  .S..II 

urer  NMT>.a/.M/.re/i.a«/ut/u 

U4M  FN.R*  (FOKF.I/MIl.R)*  IFCIS/TK) 

urea  KKM>TaaiiFCKn«Mii.ifa«i».<i 

i  rear  rmn+/.mu.m.mf.tw.m 

urea  Mii.i«Taa*tMiRT'T!ci.R't'i'.i> 

irear  Miirt.aai/.K/.as/.aa/.aa/.ia/.i/.is/.sM/i.a 


POS*  17X3 
IX4699 

PC  •  pi 


CAfMUTf  (Potoff/Aiacaani 

1  KMIK  MX  OUPlIO  HUCMIMLCSS) 

.  C4P4IILIT!  TMLC  (POSIT  4I4CMFD 
,  PO  4I4CMTT  IIIKMIHXXtt 
a  UMCin  (MIIXMXE  •CTIM/KMMCL) 
ML  C4MCITT  TMLC  (Mill  4CTt/POMMftl 


.lQnriiiuj 


ILu! 


ill  <7)f  •  HI 


UN  Mill  -  MIIT4IM4IIITT  IMS  (Mill  XTS/4I4CMFT> 


TM  •  TflfL  MKMH 

a  .1*140  ICC!  *M.«  .9.4494.  11791  *OM.K 
£C1*IVl4/l3/l2.VI2/ll/19.Vl#/4 
OM.I>IMX<CNOT.TtCM.K.4.l..l> 
001*1/1.0/1.1/1.15/1.2/1.0/1.3/1. 33/1. 4/1.49/1. 9 
EC  ■  EMI  MOT  CMMILITI  (POEOT/4I4CMFT1 
ECT  •  CWIMOT  C4PMILITT  TMLC  (POCOT  (4140X11 
EMI  •  CMIMOI  KM1I  MX  0.11X10  (MMMIOESSI 
OMT  •  CWIP  40414  MX  OT  IMS  (IIMMIOEtt) 
TICK  -  XOMLKI 

X. 4*140  (ICI  .M.1 .9* 4499. 1973) 

SCI *31/21/27/0/21/22/21/14/17 
FC.I«T4O(FCT.M.I.9.440.I973) 

FCT*I9/I4/I3/I2. 9/12/1 1/If. 9/19/4 

SC  •  Wfll  C4MIILITI  (POSH/4I4C44FT) 

SCI  •  SXPLI  C4M9ILITI  TMU  (POSIT /lUCNFI) 

FC  -  FKILIIT  CXMILITT  IPOCOI/91ICMFT) 

FCT  •  FXILITI  CXMILITT  IPOCOT/4IICIXT) 

MOflim  KCTM 

FM.I*FM.J4M.'J*fXS(M.344.344)«9«LX  (Ml  .273.3441 

FM4MI 

041*2X9 

PM  2X9 

01*1X4 

04  •  FIT  IX  MOB  4MILMLE  (MMS/IURI 
041  •  FHIX  MW  III  TULL!  (MM9/IUI) 
m  -  Fviix  mm  wo  mhmi 
PI  •  PXX  XIOIT  (IMM/1KMI 
PM  -  PXX  Xian  I  (MOB/TCM) 


na.i*wi.jMi 

SL-3.3 

m  *  flux  mm 
*»  -  sonic  CMPLi 
X  -  MTTIE  LOCII 


OXIfTIM  MX  (MMKS/MII 


»  o 


ca.ka.jhtmcta.jkm.jo 

mm  oka! 

2#4M  CAI4MTAC 

um  ai>2.f 

2S4#  CA  -  OW  AMILMMTT  (OWS) 

217#  CM  •  OWS  AVAIlARi  IIITUU.T  (OWS) 

MM  a  -  OW^MTIS  (OWS/AIACMFT) 

im  TAC  •  MTU  MlOlin  (AIACMFT) 

2IM  CM  -  OW  TM1I1K  Mlt  IOWS/MT) 

21  If  CM  -  aw  MMITIM  MIC  (OWS/MTI 

212MMC 

21 JM  CM.NL*  (CAl  *  <4M*Sli(4.2tl*TIH.K/CFOl  1 1  /IT 

2IMC  nr-.  23 

2l3fC  CFOMI2#  9  TIMS 

214#  CM  •  OW  MMIIK  MTC  IOWS/MT) 

2IM  CM  -  OWS  AMHAU  IIITULLT  <OWS> 

2IM  AM  •  MPIITMI  M  SIM  IMVT  tllMMIMIK) 

l\H  TIM  -  SIMLATIM  TIM  CLICK  HATS) 

22M  MO  •  MAIM  IF  SIM  IMVT  (  MTS) 

22lfMTf 

222M  CM.M'CA.R/CML 
22MC  CKL'IiSi  «  TIMS 

22M  CM  -  OW  ATMITIM  MTt  (OWS/MTI 

223#  CA  -  OW  MMIMIUTT  (OWS) 

224#  CML  -  OW  KLAI  (MTS) 

227IMTI 

22ML  SS.»SS.#»fT*(SM.JM«flUI(-SS.J.S44«344l 

am  ss-ssi 

23MC  SSI"# 

291#  SS  •  SCMMLO  MOTHS  (SMTIUl 

232#  Ml  •  SCMMLO  SMTIO  IIITULLT  ISMT1ISI 

23M  SM  •  SCMMLO  SMT1I  MTI  ISMTICS/MT) 

294SMTI 

233M  SM.IL'AM.I 

294M  AM.RKLIFOMA.IiCA.IiCA.SiLIM.1) 

237M  IMAJKL  IF  <MA  .1  *  AA.(*AA.K  »MA.K) 

23SM  MA.I*  ( (FMA.K/SL)  /  (943*TT1H.K)  )*#T 
29ML  TTl>.l<lir(I.TTMU,TTUW.I44l*#T 
2  MM  TTIM 

211#  M  •  SCMMLO  MOTII  MTI  (SMTIIS/MT) 

242#  AM  •  MAIIMLS  SCMMLO  AIACAAFT  ISMTICS/MT) 

249#  IMA  -  l  HIT  MTMO  SMTttS/AIAOMFT  I  SMTIIS/MT  I 

244#  MA  -  am  SMTIO  AMILAMI  (SMTIIS/MT  I 

249#  TTIR  •  TIMS  TIM 

I444MTI 

24711  SVCS.I*SKS.#*OT*(IO.J()«FMM(-MCS.J*  944*344) 

24SM  NCS*MCSI 

244#C  SMSI*# 

29M  MCS  -  MMS«t  SMTIO  (SMTIO) 


nu 

aa 

Tsmm 

am 

asm 

a** 

n7K 


OH 

IM 

till 

aa 

ZUMTC 


sucsi  -  succcssm  smtici  iiituut  imtied 
tea  -  same  cafierin  mtc  ismtics/mti 

stt.a.*ssa.j(»$caF.K 

sciF.i'i-MantM.atMM.K 

M*.M 

S».« 

tea  -  tame  caviniM  mtc  tsames/Mn 
sta  -  toenail  same  mtc  <sktics/mt» 
tar  -  same  cmpixtim  mtc  fktm  niimiaussi 
u  •  same  mmt  km  (iimsiaussi 

a  •  STMMM  KVIATIM 


yi 


A.  i  if-i<i 


nsaarc 

2MK 

T47M 

Ml 

uaac 

si*ai 

urn 

■  •  KM  CKIKCKS 

tm 

■i  -  n  CKiscas  hit  unit  (DKtnasi 

mtrnn 

mm 

M.KHUF.I 

T7JM 

HMC 

M»*7n  !  TCMS 

tm 

m  -  aianc  mtc  ikikem/mti 

am 

m  *  Nuuk  mtc  r*cm  wimmmu 

tm 

ai  •  Kin  urn  m  ckikcm  (ociaccasi 

HIM 

m«T 

3121 

313# 

3IM 

3139 

3U9 

3171 

32’IMTI 

32M 

J2NSKC 

33Mn.IT 

331MIIT 


cM.n.*a.K/aa 
AKL'3449  19  TUK 

CM  •  OKISCI  ITTIITIM  MTC  (£*CIK£**/MT? 


ATTtlllM  KLAT  (MTS) 


It.XOMM.  I KT.  TtCN.K.9'  |  .1.  .01 
IIT*.H/. #13/. #♦/.!/. 2 
IM.KM-H.K 

TlCtl.K*TMM.(TCaiT.a.K.9>  IM9.  INI 
TIOIT*9/.94/.M/.ll/.l4/.2/.tM/.M/.M/l 
II  •  IMCKIT  KL1MIUTT  (IIKKIMUSSI 
IM  •  MOOT  KL1MU1TT  TMU  (IIKKIMUSS) 

IM  •  IMCKIT  KLIMIUTT  MR. Tin. ID  (IlKMIMLESS) 
TICK  -  TICMNUCT  II1KM1MISS) 

TICMT  •  TCCMML9CT  TMU  (HKKIMUSSl 

a  •  cvaioKO  ekucos  (Ercikosi 


JN  CMTVM.  STITOCITS 
IT* .  I  .KTKI.3M.IWT**  1929 
FM*f/M*9/M*R/MI*l 
SCt*$/KM*«/KM*« 


* 


APPENDIX  B 

DERIVATION  OF  REPAIR  CAPABILITY  AND 
AIRCRAFT  MAINTENANCE  CAPABILITY  EQUATIONS 
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Two  supplementary  equations  were  formulated  as  an 
attempt  to  measure  the  additional  capability  that  exists 
in  the  operational  reliability  system.  The  equations 
determine  the  total  personnel,  supply,  equipment,  and 
facility  capability  availability.  The  terms  in  the  equa¬ 
tions  are  adjustment  factors,  determining  the  increased 
capability  provided  by  the  Research  and  Development  sector 
The  capability  requested  to  generate  the  system  was  then 
subtracted  from  this  total  capability.  The  result  is  the 
additional  capability  available.  The  equations  are: 


RCAP . K- ( ( 10 0+(  PC . K-PC . K/ PRRM . K ) ♦ 


(EC.K-EC.K/ERRM.K) /100)-ARF.K 


ACAP.K-5000+AM.K* ( ( (PC.K-PC.K/PRRM.K) ♦ 


(EC.K-EC.K/ERRM.K) ) /100-1) 


When  policy  changes  were  tested  in  the  model,  addi 
tional  adjustments  were  required  to  compensate  for  the  10 
percent  and  25  percent  decreases  in  supply  capability. 
These  equations  are: 


10  Percent  Decreace  in  Supply  Capabilit' 


RCAP.K-( (97+PC.K-PC.K/PRRM.K) ♦ 


(EC.K-EC.K/ERRM.K) ) /100)-ARF.K 


ACAP.K-4850tAM.K*( ( (PC.K-PC.K/PRRM.K) + 
(EC . K-EC . K/ERRM. K) ) /100-1) 

25  Percent  Decrease  in  Supply  Capability 

RCAP . K- ( ( 92 . 5+PC . K-PC . K/PRRM. K) ♦ 

(EC. K-EC. K/ERRM. K) )/100)-ARF.K 

ACAP.K-4625+AM.K*( ( (PC.K-PC.K/PRRM.K) ♦ 
(EC. K-EC. K/ERRM. K) ) /100-1) 
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APPENDIX  C 

INITIAL  SIMULATION  RUN 
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APPENDIX  E 

THREE  TO  TWO  LEVELS  OF  MAINTENANCE 
POLICY  CHANGE 
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